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ABSTRACT 



Thisreport describes and analyzes statistical 
indicators of educational knowledge production and* dissemination 
capability, presenting data at both the state and regional levels of 
aggregation. Ihree factors underlie 12 statistical indicators: a 
document production and access fact or , a human-baSed linkage and gr 
^exemplary practices factcr r . and a state planning and capacity <a 
building factor. 'A score of selected demographic, economic, and 
educational "measures are used as potential predictors of the 
knowledge production and dissemination indicators. Factor aaalysis of 
these measures produces seven "predictor" factors: (1) staff size and 
number'of educational agencies; ' (2) educational expenditures ; (3) 
"relative expenditure effort; (4) population and 'institutional 
^density's (5) population change;* (6) Intermediate Service Agency (ISA) 
service level, and (7) Teacher Center (TC) service level. Multiple 
and canonical correlation analyses demonstrate. that the size factcr 
alone £s a powerful predictor of all indicators that are based on 
counts, ^let^rchical grouping analyses of the 50 states and the 
District of Columbia are made, separately, and the state-level data 
are aggregated by the ten United St at es N Of f ice of Education . (0S0E) 
Regions, based first on production and dissemination indicators , and 
then or contextual predictors. (Aut hor/CWM) 
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ABSTRACT 



Stat istica Vindicators of educational knowledge production 
and dissemination capability are described and analyzed, 
with data presented at both state and regiona.1 levels of 
aggregation. Three factors are shown to underlie 12 statis- 
tical indicators: a document production and access factor, 
a human-based linkage and exemplary practices factor, and 
a state ^planning and capacity building factor. A score of 
demographic, economic* and educational measures are selected 
as potential predictors of the knowledge pT^lictidn and dis- 
semination indicators. Factor analysis of .these measures* 
produces seven "predictor" factors: 1) staff size and number 
of educational agencies, 2) educational expenditures, 3) rela- 
tive expenditure effort, 4) population and institutional d.en- 

* sity, 5) population change, 6) Intermediate Service Agency 
(ISA) service level, and .7) Teacher Center (TC) service level. 
Multiple and canonical correlation analyses demonstrate that 
the s\ze factor alone is a powerful predictor of all indica- 
tors that are based' on counts (e.g., number of documents, 
number ,of computer search services, number of validated prac- 
tices. The remaining predictor factors add small predictive 

. increments, especially for the non-ERIC-related indicators. 

* * * » 

Hierarchial grouping^nalyses of the' 50 states and the Dis- 
trict of Columbia are made separately, first based on pro- 
duction and dissemination indicators, and then based on con- 
textual oredictors. The two types of analyses are shown to 
produce similar typologies of states. 



Finally, the state-level data are aggregated by the ten USOE . 
Regions. Substantial differences among the regions are 
found on both the knowledge production and dissemination in- 
dicators and on the contextual predictors. The results indi- 
cate that there are regional as well as state-level effects 
operating, either directly on educational knowledge production 
and dissemination or indirectly through contextual factors 
such as size, wealth, and number and types of intermediate 
structures. 
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-INTRODUCTION, 



Overview . >>. •.. 

One of the general objectives of the Educational Dissemination Systems 
Support Program (EDSSP) is to'e'stabl ish efficient means' for analyzing, moni- . 
toring and communicating the status, needs, and accompl ishments of educational 
dissemination performers... Previous EDSSP reports have summarized a number of 
research studies, surveys, evaluations and other descriptive information per- - 
taining to federal, state, and local dissemination programs and performing 
agencies.- Since the content of . the majority of these studies focused on spe- 
cific programs^e.g., the National Diffusion Network), "or special agencies 
(e.g., schools, colleges, and departments of education) 'we began to look for 
r sta J^ st >^l data which might possibly provide more comprehensive coverage^ pro- 

pr™ammatl(;ally, agency-wise* and geographically. 
. • The initial impetus for our first exploratory study began somewhat acci- : 

denta-Fiy, A visiting, scholar was planning some case studies, within individ- 
ual states, of inter-organizational arrangements that were designed to support * 
educational dissemination and practice improvement activities (Paul, 1978)-. We 

asked the following simple questions: Which states should be selected for case 

«?, ; .• 

study? Could states be typed? Was there any objective basis for typing states 

that wduld be relevant to educational dissemination? If so, would this typol- 
ogy be helpful in selecting states for case study or in generalizing case study 
findings? • 

, EDS^J* staff had already begun collection of a wide variety of dissemina- 
tion and utilization "data on all 50 states (EDSSP Technical Proposal , April* 1978). 
' : We sifted through these State files to^ identify data elements that might/ serve* 
as dissemination capacity indicators . Eight indicators were identified in this 

ERIC 
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initial search. We a-lso und ertoo k a search for knowledge base indicators j .__ 

that" could be associated with each state. Eventually five knowledgebase in- 
dicators were identi fed. Our search for satisfactory utilization iificators 
proved fruitless. Although we failed to find acceptable indicators of know- 
ledge .utilization,-, it was possible to locate or create a large number of - 
"contextual " indicators (pertaining to population, economic or educational 
structural data) that might act as predictors of the state-level knowledge 
production or dissemination capacity indicators*. 

Following preliminary visual examinations of univariate and bivariate 
data distributions, several variables were transformed to produce more normal 
distributions, and two new variables that were ratios, of original variables 
were created. Eventually, our exploratory data consisted of 13 production and 
dissemination variables and 22 predictor variables. Factor analysis of the 
predictor variables produced seven factor scores that were used in place of 
the original 22 predictor variables for^many subsequent analyses. A variety 
of multi-variate data analysis techniques were then employed to examine the 
relationships within and between the predictor and the production and dissemi- 
nation indicator data Sets, and to examine similarities and differences between 
states in terras of these data. After examining state-level data, the states - 
were grouped by USOE regions and additional analyses were made in terms of the 
ten USOE regions. The development of the indicators and theresults of state- 
leVel and the regional-levelanalyses are described in subsequent sections of 
this report. * • 

The, Conceptual Framgwork and Approach * 

V 

The notion of "social indicators" (Bauer, 1966; Sheldon and Moore, 1968; 
Grdss, 1969;- Van Dusen, 1974) plays- an important role in the approach we ■ 
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have\ta ken. - A -social Indicator may be defined as "a statistic of direct 



normative interest which facilitates concise, 'comprehensive, and balanced 
judgments about t)*e conditions of major aspects of society" (DHEW, 1969). 
In the field of education, there are many examples of the use of indicators; 
however, virtually none of these educational indicators have a direct bearing 
on educational ^knowledge production, dissemination, or utilization (KPDU), 
although some of them (e.g.,* size and type of staff, number and type of 
institution, level of funding) might serve as "contextual" variables that 
might be related to educational knowledge production, dissemination, or uti- 
lization (KPDU). 

Hood (1979) describes a model 'for a system, of KPDU. Indicators coh- 

'r- sisting of four components: 1 ) -indicators of educational knowledge produc- " 

\ * * i 

tion 'outputs . 2) indicators of educational knowledge dissemination structures , 

-3) indicators of educational knowledge util ization . and 4) indicators of 

contextual factors that may be used to predict or explain the patterning 

of the other types of indicators. \ - ^ ■ f „ ■ .'• - - 

Production output indicators are concerned with estimates of the type, 

quantity, quality, or other characteristics of quantifiable units of educa- 

> ' v - v 

tional knowledge (e.g., documents) as related to their origin (e.g. , author 

or institution location)*. Ideally, these indicators should reflect t^ 

extent and ways in which the educational knowledge production community 

organizes and transforms knowledge in all its forms. Currently available 

data pertain primarily to formal documentary or formal oral forms o^ their { x - 

derivatives (e.g., abstracts, citations, pro'ceelBfcs ) . 
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Dissemination. structure indicators are concerned jwith the characteristics 
or capacity of structural or .functional components of the educational dissemina- 
tion system^ (e.g., number and type of information search services, numbef and 

. . • :j • / ■ to ' « ■ 



type of linking agents). In general, these indicators should display how 



educational dissemination* resources— funds, people, products, services, and 
technology— are allocated across educational sectors and geographic areas. 

Utilization indicators should provide information regarding request ,and 
;usage rates, adoptions, impact, benefits, etc., by geographic or educational 
sectors, for types-of institutional and individual consumers of educational 
.knowledge* products, and 'services. Currently there are very few satisfactory 
utilization-indicator available on a nafi^nal basis that can be used to in-- 
form us regarding the various facets of knowledge utilization or its impacts. 

, Contextua l indicators provide information concerning distribution across 
geographic areas of changing composition and^rends of aggregative data, that 
reflect the demographic, organizational, social, political, economic, and 
educational environments for educational knowledge production, dissemination 

^ .... ■ ' 

and utilization. Contextual indicators can reflect conditions or forces that 
may serve to supply, support, constrain, or otherwise influence the production 
dissemination, or consumption of educational knowledge. 'V. 

Relationsh ip Among Types of Indicators . Because of the sometimes' highly 
local connections of productiog, dissemination, and utilization (e.g. within 
ah immediate primacy group or within one organization), it would not be sur- 
prising to find strong correlations between some types of production, dissem- 
ination, and utilization indicators, especially those thatmay.be based on 
Counts of units or entities. However, there is also strong reason to suspect- 
that contextual factors (e.g., population density, per capita wealth) might 
constitute common underlying factors that may account for much of the observed 
correlation between production and dissemination indicators or between dis- 
semination and utilization indicators when aggregated by region or state. 
For example, one might expect that more populous states or regions, would 



\^ display hi gh^^ourjt s of patxHcations, higher numbers of information' search 



se.rv.fces, and higher numbers of organizational and individua] requests for 

' information searches than would less populous states or regiqns. It is also 

. easily conceivable that relatively wealthy states and regions could afford 

t v. .' ■ ., • • 

to fund more knowledge production (e.g., research studies, innovative prac- 
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tices) , support moFe extensive and expensive dissemination services, and 
create educational consumer environments with the organizational "slack"* and 
incentives fostering less parochial forms of ^knowledge consumption. Hence, 
contextual indicators need to be considered when examining aggregate data. 

Hood (1979) presents a ^dimensional \axononjy for analyzing the educa- 
tional kjfowl edge base/ the formal dissemination structures and arrangements 
that« haf|Ibeen created to ^fecll it-ate communication or to provide access to 
knowledge in education, and ttie various conceptions and associated data 
bearing on knowledge utilization. He also discusses the implications of 
these taxonomic dimensions for the development pf educational KPDU indicators 
(op cit.% pp. 19-22; 27-28; 4Q-55). Summarized briefly, most of the detailed 
information about, the educational knowledge base refers to the more formal 
types of documents and materials that are indexed by national information ; 0 
systems. This type of information constitutes only a very small part of... - . 
the total knowledge base in educatidn. We know very little about the ton- 
tents of knowledge that is communicated orally or informally. Although we 
have extensive statistics on libraries and we know a great deal about the 
wide variety of other types of ed^ca|fdnal dissemination services and struc- 
tures, there is very little information about the nationwide distribution of 

,j • ... . . » * 

> . c ■" 

most non-library services. In utilization, a similar situation is en- . 
countered in which several different lines of research have produced a rich 4 ^ 
mass of descriptive information; .but, aside from relatively superficial and 

■ '12 . ' • . ■ 



' . <*• *) . • >. ■ v • ■ . ■ , 

sometimes spotty marked survey, project adoption/ or user request data, there 
are virtualjy no accurate, nationv/idfe indicators of educational knowledge r < 
utilization. A ' \' " *■ 



* BUILDING A DATA FILE' 

• ": , ' ^ . 
Indicators of Knowledge Production ^ ' 
'. ^i- SjH — - 

For our Ixpl oratory work we created five indicators of knowledge pro- 
duction: , 

• Number of Resources in Education ( R I E ) documents in ERIC 
(cumulative to 19?8)^j^roduced in each state^ 

t Number of documents in ERIC, produced by State Education 
v Agencies (cumulative to 1978). 
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t Estimated relative number of documents in ERIC (1972-75), 
produced by the schools, col.leges, and departments of edu- 
cation in each state. 

t ^Number of JDRP-approved/DD-funded exemplary practices. 

t x Number of State-validated (IVD) practices. 

Statewide RIE Production . The first indicator was created by special f 
computer searches of the entire RIE file on the Lockheed DIALOG system to 
obtatn counts by state of the ''institutional soured" field for each RIE entry. 
Because the RIE citation conventions employ a compact, non-redundant style> 
several types of searches had to be employed, difference reconciled, and, 
in one case, a regression estimate made.* Note that this indicator is a 



For example, if the s1fot&*name appeals in the institutional name, e.g., 
Washington State Depqftment of Education, the state is omitted. Hence, 
both state and institutional fields must be searched. However, institu- 
tional names that include words that are the same as state names, e.g., 
George Washington School District, in Washington state or in another state, 
create special problems. Some were solved by using Boolean sets. In one 
case, the State of Washington, a multiple regression equation based on 
data for all remai^jng states was used*to .estimate the count. 

13 



cumulative count based on "over -12 years pf systematic RIE accessions. (It 
also includes USOE-sponsored research reports dating back to 1956.) State 
counts range from over 100 to over 8,000 RIE entries. Although there 
may be some yearly fluctuation in the proportional rate of RIE accession- 
from state to state (a matter which may be investigated later as part of 
planned time series analyses), it seems reasonable to assume that, gtven 
this 12-year cumulative base,^the relati\lfe positions of the 50 states (and 

DC) will 'remain moderately sta'ble overtime spans of several years. For 

/ * 

data analysis purposes, raw state counts were converted to logarithms.* 

/-What does the State RIE indicator represent? RIE is t)ne of two docu- 
mentation services provided by ERIC. ^ (The other, Current Index to Journals 
in Education, CUE, ihdexes journal 1 iterate re.') RIE includes published 
reports and fugitive documents not published elsewhere, e.g., project reports 
speeches, con|nittee reports, handbooks, instructional modules. Because the „ 
RIE accession of federally-sponsored -education research reports reaches back 
to 1956, this base provides one of the most accessible And useful indicators 
of "raw" production over much of the less formal end of the continuum of edu- 
cational documentation.,- 

State Education Agency (SEA) RIE Production . This/indicator is similar 
to the previous ir^caTor, but is confined to the cumulative count of all 
SEA-produced documents in RIE through 1978 (transf ormzd to log 10). 



* Logarithmic transformations (base 10) were used consistently to transform 
all fi^urit data for various indicators where the maximum state count* 
exc£e<ted 25. Generally, raw count data for states exhibit highly skew 
frequen/cy distributions. A logarithmic transformation tends to make the 
distribution more normal and also tends to stabilize the standard devia- 
tion. For statistical analysis involving variances and covariances, the 
log transformations tend to prevent^excessive weight from being given to 
extreme values. 




Schools, Colleges, and Departments of Education (SCDEs) ERIC Produc- 
tion. This indicator was derived from SCDE productivity data reported by 
Clark and Guba' (November 1976). Among seven Clark and Guba substudies of^ 
SCDE knowledge production, two substudies were most comparable to the state- 
wide RIE and the RIE-SEA counts. These were the Educational Journals Study 
and ttie RIE Study. In the Educational Journals Study, all articles, essays, 
and reviews in each of 26 national journals were recorded for a three-ye^r 
period of time (circa 1972-74).* The authors of these journal entries were 
tracked to the institutions or agencies in which they were employed at the 

time the publication was issued and, where' possible, to their departments 

^ • .... 

within institutions* '-Contributions were recorded with a maximum of 1.0 
^^J^editl per article, with fractional credits for multiple authorship. 

In th6 l RIE Study, all RIE abstracts for a two-year period (April 1, 
1973 through March 31, 1975) were accessed and classified by type of source ' 
Institution. All RIE entries which wejcp certainly or likely housed in the 
SCDE of higher education institutions vyere classified by the RITE system which 
classifies the national population of SGDEs"(N = 1,367) into 12 categories. 

■V 

By employing SCDE institutional productivity data for journals and RIE 
reported by Clark and "Guba for each«type of SCDE, an overall institutional 



/ 



* Criteria for selecting theSe 26 journals out of the more than 700 
journals covered in CUE or other educational journal indexes were 
that /they had been identified in previous studies as being significant 
in the growth of the knowledge base in the field of education, they 
included practitioner-oriented journals in balance with researcher- 
oriented journals, they represented a spectrum of substantive areas in 
education, or they were among the highest circulation journals in educa-, 
tion. The reader should note that CUE citations do not' identify the 
institutional source of the CUE entry; therefore, computer search of 
CUE to obtain state counts is not possible. / Statewide or SEA counts 
for journal production would have to employ some kind of journal 
sampling and author-to-source matching similar to that employed by 
Guba and Clark. * 

is 
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productivity weight was developed for each of the 12 SCDE .categori|s.* These 
weights were further refined to adjust for wi thin-category institutional pro- 



ductiyityxra-viabpity by ©resting "above average," "average," and "below 
average" Wights for each of the 12 categories. A productivity weight was 
then/assigned to each of the 1 ,367 SCDEs. The weights for all SCDEs in each 
state we^e summed ,to pfoduce a S*ate"»SCDE productivity estimate. These esti- 
mates, which^afT ^roportional to 'the state's total' annual SDCE productivity 
in 26 "core educational journals" and in RIE,- were then transformed , to loga- 
rithms (base 10). It should be noted carefully that the journal estimate is 
confined to only 26 core journals and thus represents only a small fraction of 
the total educational journal production; however, there is a strong presump- 
tion that, if many more journals had been included in the journal sample, it 
probably would not change significantly the SC^productivity .rank ordering at 
the state level of aggregation.** Because the derived index is a composite 
of RIE and of counts of only 26 core journals, we are not claiming that this- " 
index is an indicator of absolute numbers. However, we do believe that it 
is a good estimate of the relative numbers of documents that the total of all 
SCDEs in each state may have contributed to ERIC (bot.h RIE and CUE). Because 
the SCDE knowledge production indicator is based in part on jourHat production, 
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The average" SCDE produced 1.08 journal credits per year and 0.66 RIE 
entries; however, "Public R&D Center" SCDEs averaged 19.5 journal/credit 
, per year and 12.4 RIE entries per year. - ^ 

** Increasing the number of journals sam led would have served to increase 
the ratio of journal credits to RIE entries in the composite estimate. 
While developing the SCDE production weights for each RITE category, trial 
computations were made for separate indexes based on RIE and on journals. 
The correlations across the states were so high that it was decided to 
combine the two estimates into a single composite. 

Je ' 



this indicator covers an even Wider range of educational 'documents than the/ 
statewide RIE or the SEA-RIE i/ndicators.-* ♦ 

JDRP-approved and DD-funqed Exemplary Practices , While the three previous 
indicators all deal with documents, this indicator; measures the production of 
exen^lary practices in each^/state that are of sufficient quality to pass the 
review of the HEW Joint Dissemination Review Panel (JDRP) and to qualify for 
funding as an NDN Developq/r/Demonstrator (DD) project. Educational Programs 
That Work (Far West Laboratory, Winter 1977)' was the source for this data. 

State Validated (IVD) Programs . In the Fall 1977, the Florida Depart- 
ment of Edudation, ESEA (Title IV-6 Office, conducted a survey of state program 
certification methods. iThe survey casked for the number of certified programs 
developed through old ESEA Title III or new^ESEA Title IV-C as of September • /' 
1977. This indicator is the total of programs Certified by either USOE/ 
NASACC or other certification methods than JDRP.** 

ReJationiship Among the Knowledge Production Indicators . * 

- Table 1 displays the means, standard, devtiartionis^ and correlations^for 
these three knowledge production indicators. _ • 



r 



* The Clark and Guba productivity study (pp. V-49 and 50) indicates -that SCDE 
production accounts for over half of all journal credits in practitioner- 
oriented journals and nearly two-thirds of all journal credits for research- 
on* ented journals in the sample of 26 journals. 

** USOE/NASACC— The U.S. Office of Education and the National Association 
of State Advisory Council Chairmen for ESEA Title III published Sharing 
Educational Success: Handbook for Validation of Educational Practices 
(1974). JDRP-validated programs were not counted since another indicator 
is b^sed on the JDRP count. ¥ 
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MEANS, STANDARD DEVIATIONS (S.D.), AND CORRELATIONS FOR , 
, FIVE^ EDUCATIONAL KNOWLEDGE PRODUCTION INDICATORS 

(N = 5QT States and D.C.) u 



0 





. - if. • ; 

INDICATOR 




■ , * • 

MEAN 


S.D. 




CORRELATIONS 








7 1 
State 


SEA J 


SCDE 


4 

JDRP 


* 5 
IVD 


l. 


State RIE count 


.(lot,) ' 


2.92 
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0.45 
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3.45 


3.38 
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.57 
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.64 


5. 


* State IVD count 




.79 


0l"S3 


.44, 
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.40 


.64, 





We note first that the means for statewide RIE and SEA-RIE production 
are directjy comparable and that the SEA-RIE count, is a/^frset of the total 
statewide RIE count.* Although the SCDE productivity estimate is also ex- 
pressed in logs, no diredt comparison can be macfe^with .statewide or^SEA'data 
because the SCDE .data are estimates of relative numbers rather than absolute 
numbers. « . 0 t 

"Tne correlati^ display strong, but far from perfect fntercorrelation. 
The stronger correlations are between statewide RIE and SCDE productivity 
(.84) and between statewide RIE and SEA-RIE productivity (^72). The correla- , 
tion between the SEA and SCDE productivity indica^^^fs markedly less, but 
sti]l substantial (.59). Number of JDRP-approved projects is moderately cor- 
related with all three document production indicators (.57, .57, .47). Number 



* Arithmetic means of log-transformed data are the geometric means of the 
raw count data. The anting of 2.92 = 832., which is the geometric mean 
for the statewide RIE count, the antilog of 2.07 is 118., which is the 
geometric mean of the SEA-RIE count. The ratio of these two geometric ' 
means is approximately 7*1« 
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$ : of state-validated^ (IVD) projects is also moderately correlated with all three 
' document production indicators (.44," .53, flO) , and is even more strongly cor- 
related with tjie JDRP count (.64). - 

It is possible to construct a number of additional indicators of knowl- 
edge production that are based on document systems (e.g., books in print, 
journal counts for various types of journals, RIE counts for various, subject 
matter sectors, counts phased on professional meeting program listings or ses- 
sion abstracts; and all of these counts may be cross-clasVified" by type of edu- 
cational institution or. by educational sector). However, the\cost of creating 
the data is considerable. So, for exploratory purposes, we stopped with these 
five indicators. Their' interconnections are sufficiently .high,- but not so 
extremely high to suggest that they are' indexing different facets of \\e ■ 
general level of knowledge production' in tfie® states (and DC). 

Indicators of State Dissemination Capability . . 

Eight indicators of state dissemination capabil ity we're identified. The 
first three^are' related to the ERIC system: 

ERIC Standing Orders . This indicator is based on. the count of the number 
of agencies in each state that maintain standi ngrorders for ERIC microfiche: 
Standing order customers usually maintain complete ERIC collections (e.g., 
RIE, CUE, mi 'crofMfh^ and readers) and are asually open to the public. If 
complete throug^^JflF, an ERIC microfiche collection would contain over 
140,000 titles. The standing order counts were obtained from ERIC Central' 
in Spring 1978.* Counts ranged from 1 to 56 collections per state. The raw 
scores were 'transformed to logarithms (base 10). 



Now available' in Directory of ERIC Microfiche Collections . ERIC 
Processing and Reference Facilfty. 



ERIC 



Computerized Search Services . This indicator is the count' of the organ- 
izations in each state that were currently providing computerized searches 
of the ERIC, database as of Spring 1978.* At that time, the number of com- 
puterized search services ranged from* zero to 23 .per state. - 

ERIC Clearinghouses , / This indicator is the count (0, 1, or 12) of ERIC 
clearinghouses in each state.** : * '/ ■ 



In addftion to these three ERIC-reTat6d indicators, there are three 

ship: 



indicators that ar§ related to State Educational Agency dissemination leader- 



State Capacity Building (SCB) Grant Status . > In FY 1975, the National 
■ Institute of Education initiated the Stat^Capacity Building Grant Program! 
SCB provides support for three to Hye years for each state educational 
agency (j^AJ*tj£rfT chooses to participate < in this program* to build compreblen- 
si ve cfnd continuing dissemination capabil*iQty. The 28 states that were /recip- 
ients of SCB grants in Spring 1978* received an indicator score of States 
that were recipients of Special Purpose Grants (that usually are planning pre- 
f cursors, to *full SCB status) received a score of "1." JJcrtes that were^not par 
ticipating iij^he^SCB program received a score of "0." 

' « State Dissemination Plan . State education agencies have been encouraged 

/ % / J '\ 

. to adopt states)! ans for educational dissemination. These plans^majy include . 



* Survey, of ERIC^Data Bases . This reference has been replaced by the 
Directory of ERIC Search Services , prepared by ERIC pfbcessing and 
Referenqe Facility. 

** ERIC Clearinghouses are organized by subject content areas and may be 
considered national resources. However, because most clearinghouses 
will allow visitors to use their collections, presence of one or* more 
ERIC Clearinghouses in a state is a dissemination assent During the 
past two years, several USOE-funded clearinghouses hp4e been estab- 
lished. These will be addled when this indicator^r^updated. 
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dissemination. oba'eQtlves, descriptions oj strategies for accomplishing these 
objeictiv&s, designation of roles and respohsibil i'ti&s within the SEA, iden-^ 
tification of resources; and description of evaluation methods. In Spring 
1978, 23 states wer^knowrTto ha developed or to be developing -a state plan. 
These states were scored 1'2." Eleven states- were known to have no plan. These 
states were scored "0." The status of 16 states and DC was unknown. They 'were 
scored "1."* ( 

R&D Exchange Service . During 1976-1977, five Regional Exchanges of RDx 
, CEMREL, NWREL, RBS, andlSEDL) provided services to 33 states.** This 
.jnicator is'a dummy variable\l. if a state was served by RDx; 0, otherwise). 
The. logic of this indicator is that the RDx regional exchanges were known to 
be working with many SEAs to -help them develop or implemenUstate dissemina- * 
tion plans andJto help* them train-state dissemination personnel. 

The following three indicators mo9s from a focus on documentary informa- 
tion ^services or SEA, dissemination activities to an att^emjrt to identify human ■ 
(e.g., lirjking agent) dissemination capabilities. 

s 4 

* • • * "a 

* R&D jJtilization Program Intermediaries . The purpose of the NIE- 

sponsored R&D Utilization Program (RDUP)r is to provide^serviceS that help 

' / i * ■ 

schools use R&D-based innovations that improve educational practice. RDUP 

includes seven field projects that l(ink resources of SEAs, local education 

■ - . } 

agencies, regional laboratories and R&D centers, intermediate educational 

agencies, and institutions of education with selected RDUP school sites/in 

• 4 



* The logic of this scale i^riot strong. We began by scoring states with 
: plans "+1, H states without plans "-1," and states where status was un- 
known "0. M Adding a constant of 1 to each score produces the 2, 1, 0 
scale. State plan information was obtained from the R&D Exchange: An 
Overview of State. Dissemination Activities. 



In February 1979, 42 states .were served by seven RDx regional exchanges. 



19; states. The number of RDUP projects, and the number of RDUP linking 
agent personnel varied among the 19 statels. A four-point indicator was 
created; states without RDUP projects were scored 0, states with RDUP pro- 
jects wege scorei^J^ 2, or 3, depending on relative number of RDUP linking 
agents operating in the state. • 

NDN State Facilitator .Ratings . By the end of 1977, National Diffusion m 
Network (NDN)* State Facitjtatgrs had been established in all but four states. 
Since a "0-1" dumrty variablfe would provide virtually no information, we asked 
persons who were familiar with NDN State Facil itator (SF) activities to rate 
SFs on a four-point (1-4') scale in terms of their dissemination capability or 
effectiveness.* States without SFs'wye scored "0." 

JQRP-approved and DD-funded Exemplary Practices . ' TMs indicator was in- 
cluded in the Knowledge Production set. Because £hese projects we re approved 
as NDN o/veloper/Demonstrators (DDs) , They Tnay al^so be considered as part of 



a state's dissemination capacity. 



Relationship, Among Knowledge Production and ^Dissemination Indicators 

Table 2 displays the ijieans, standard ((^yiations, and correlations among 
13 knowledge w^u^t^on and dissemination indicators. • Th^bnowl edge production, 
indicators appearing in Table 1 have been reentered in Table 2 as Indicators 1, 
2, 3, 7, and 8. The first six indicators located in Table 2, whicffare all 



* These ratings appear to be based on number of years in NDN, subjective 
appraisal of SF project staff skill, artf general visibility and repu- 
tation of , the SF in the NDN. ■ 

** Although the National Diffusion Network (NDN) is designed to encourage 
dissemination of DP projects beyond state lines, each state's DD pro- 
jects can be important state dissemination resources. 
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concerned with' ERIC-related document production. .or\iissemi nation, display ' 
relatively hioMjitercorrelations. 

The numbter of ERIC standing order locations (#4) is highly related to, the 
total RIE productivity of the* state (.81), the number of ERIC computer search 
services offered^. 72) , *esti mated SCDE productivity (.68), and SEA-RIE count 
(.67). There are moderate correlations with the number, of JDRP,DD-funded 
exemplary projects .( .59) , the number of ERIC clearinghouses (.45), and the 
number of- state-validated (IVD) projects (.43). The ERIC standing orders are 
also weakly associated with RDUP. linkages (.36),. -RDx service (.27), and. NDN 
State Facilitator ratings (.25). ' 

The number of ERIC computer search services (#5) is correlated with 
the State RIE count (.77), number of computer search services (.72), schools, 
colleges, and departments of education (SCDE) productivity estimate (.69), 
SEA-RIE cfctant (.64), number of ERIC clearinghouses (.57), number of JDRP- 

* v . 1 

approved/DD-funded exemplary projects (.52), and number of state IVD- 
validated projects (.42). There is small association witfPNDN State Facil- 
itator ratings (.26) , SCB status (.22), and RDU'linkages (.18). 

In general,' the ERIC Clearinghouse count (#6) . displays smaller correla- 
tions with the 12 indicators than any of the first 5 indicators listed in 
Table 2. The higher correlation^ are with State-RIE count (.60), ERIC com- 
puter researches (.57), ERIC standing orders (.45), SEA-RIE count (.41), 
SCDE productivity estimate (.36) , and JDRP, DD-funded\ projects (.29). 

The number of JDRP, DD-funded exemplary projects ](#7) is most strongly 
correlated with number of state' IVD projects ( .64). It displays correlations 
between .47 and .j>9 with the first five indicatorsV^This DD count is also 
correlated with RDUP linkages -{. 51 ), State Capacity Building (SCB) status 
(.38), NDN State Facilitator ratings (.33), and ERIC clearinghouses (.29). 

\ : 2 3 
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MEANS, STANDARD DEVIATIONS (S.D.), AND CORRELATIONS FOR 
THIRTEEN STATE-LEVEl EDUCATIONAL" KNOWLEDGE PRODUCTION. 

AND DISSEMINATION INDICATORS " \ 
(N = 50 States and DC) \ 
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- Number of state IVD projects (#8), which excludes JDRP/DD projects, is 
correlated .64 with number of JDRP/DD projects and .53 with the SEA-RIE 
counts. This Matter (^relation with state education agency RIE productivity 
is somewhat higher than the correlation with State RIE count (.44) or SCDE 
productivity estimate (.40). Other moderate sjze correlations are with 
number of ERIC standing orders (.43) and dumber of ERIC computer searches 
(.42). ..Similar correlations include RDU linkages (.32), NDN Stat6 Facilitator* 
rating (.28), SCB (.27), and RDx (.25). * < 

State capacity building (SCB) grant status (#9) is the first of the 
listed indicators that shows no appreciable correlation with any of the 
six ERIC production and dissemination indicators (#1 to #6)* There are 
four moderate correlations with: state plan status (.54), number of JDRP/ 
DD-funded exemplary projects (.38), RDUP linkages (.28), and IVD, county. 27) . 

State plan status (#10), as noted, is moderately correlated with SCB 
status (.54). Since one of the objectives of SCB projects is to organize 
state dissemination .activities, the presence of state plans might be con- 
sidered to be an effect, of SCB.* Aside from a very modest correlation with 
RDx (.27), this indicator is generally unrelated to the remaining ten indi- 
cators. 



Jhe reader may recall (see page 14) that it was not possible to deter- 
mine from available data whether 16 states and DC had state plans. If 
these 17 states (including DC) are excluded, the relation between SCB 
and a state plan is even stronger: * 

• . Plan Plan 

* -> Yes No 



SCB grant (multi-year or Special) 

No SCB grant 
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RDx-served States (#11) . In. addition to a modest correlation with IVD 
(.25), states that were served by RDx regional exchanges' ifl 1977 tended to ; 

• I 6, ' 

.have a state dissemination plan (.27), higher college of education* -(SCDE) 
productivity (.25), and more ERIQ standing order locations (.27). 

RDUP Linkages (#12). This indicator displays moderate correlations 
with several other indicators, including: JDRP/DD- funded .exemplary pro- 
jects (*51), SCDE productivity (.45), statewide RIE count (.38), ERIC 
standing orders (.36), IVD project count (.32) WH State Facilitator 
rating (.29), SCB grant status (.28), and SEA-RIE count (.26). The R&D ' 
Utilization Program sought proposals that reflected significant existing 
dissemination capacity on which the RSD Utilization Program could build. 
Although none of these correlations are very strong, it appears that the 
existence and relative strength of RDUP linkages is positively correlated 
with a wide, variety of production and dissemination indicators. 

NDN State Facilitator ratings (#13) display small positive correlation ■ 
with 9 Of the 12 other indicators. The correlations in order of magnitude 
are: JDRP/DD-funded projects (.33), SCDE productivity (.33), RDUP linkages 
(.29), statewide RIE count (.27'), state IVD count (.28), ERIC computer search, 
services (.26), ERIC standing orders (.25), SEA-RIE count (.21), and SCB 
grant status (.19). - ' • 

Factor Ana lysis of Educational Knowledge Production and Dissemination 
Indicators - 

Factor analysis results . An iterated principal conBbnts factor anal- 
ysis, followed by Varinrax rotation, was performed. Four W:tors with Eigen- 
value's greater than- 1.0 extracted 74 percent of the trace. The results are 
displayed in Table 3. 



r 
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'■" _JABLE 3 : . _i_ 

FACTOR ANALYSIS ,0F THIRTEEN STATE-LEVEL INDICATORS ' f J 
OF EDUCATIONAL KQWLEDjGE PRODUCTION AND DISSEMINATION 
(N = 51 States and DC) 
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Factor I has very high loadings on all six of the ERIC (document-based) • 
production and^dissemination^ndicator.s, as well as moderate loadings on both 
of the. validated practices variables. The remaining five indicators display 
negligible loadings on this factor. Fac'tor ii is primarily a couplet, 
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^involving high loadings on SCB Grant Status ar\d State Plan Status, with very 
* small loadings for the two validated practices indicators. Factor III is 
associated almost exclusively with the RDx Status indicator, but with very 
small loadings for State Plan Status and SCDE Estimate.* Factor IV is best 
identified by. the high loadings for ROUP linkages and for NDN. State Facil- 
itator Ratings. There aVe moderate \oadings for both of the validated 

.practices indicators, and smallSrloadings for five of the ERIC-related 
indicators.Nibe ERIPClearinghouse indicator is negatively loaded (-.42). 
This suggested that* if the effects of the* first three factors are held 
cbnstant, there is a small tendency for states with ERIC Clearinghouses 
to have somewhat fewer human linkages and innovative practices structures. 

. Factor Analysis Summary . If wefexclude the singular RDx indicator and 
its associated factor, we have 12 remaining indicators, with 3 factors ex- 

. plaining most of the covariance among them. Factor I is a general knowl- 
edge production and access factor that \s strongly /associated with document - 
based indicatorsrFactor II is a state agency planning and capacity building 
factor; and Factor IV is primarily a Jiuman. linkage and innovative practices 
factor. Eight of the 12 indicators have substantial loadings Of Factor I; 
only two indicators load highly on Factor II; Factor IV is defined by perhaps 
half the indicators, but mainly by the two "human linkage" indicators. 

The two validated practices indicators, which ^wnbine aspects of pro- 
duction and dissemination of school-based innovative practices, are partic- 
ularly interesting because they display approximately equal loacjings on the 
document-based knowledge production and access factor (1) and the human 



* This small relation of RDx and State Plan may be due to the fact that 
an RDx rejtort was the basi? for assigning State Plan indicator values. 
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~ FIGURE 1 • 
PLOT OF FACTOR I WITH FACTOR IV 
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Factor-TV: We are suggesting that these two factors, one document-based 
and one human-based, are perhaps the primary factors that underly ten of ' 
the 13 knowledge production and dissemination indicators.** / 

Predictors of State-leve l Production and Dissemination Capability 

Selection of Contextual Indicators.- During preliminary examination 

of data distributions, we noted ttiat higher knowledge production and ; 
dissemination indicator counts tended to be associated with larger sJfe 
populations. Although less apparent in the data, it seemed that wealth 
might also be a contributing factor. For our exploratory work, we eventually 
selected 22 "contextual" indicators which could possibly be related to the 
production/dissemination indicators and for which infprmation was readily 
attainable. 'The 22 variables' are listed below by groups: 1 
School Enrollment and Staff Size 

• Elementary and secondary public school enrollment (ES 
Enroll.) in 1975 (log 10) . 

• Elementary and secondary public school instructional 
staff (ES Staff) in 1974 (log 10) • 

w Elementary and secondary public school consultants and 
supervisors of instruction (ES Sups.) in 1974 (log 10) 

• School librarians (Librarians) in 1974 (log 10) 

? nr ?IJ*7* 1n institutions of higher education (IHE Enroll.) 
in 1974 (log 10) 



I h f E fff clear j n 9house indicator displays a somewhat similar pattern, 
but with negative sign on Factor IV. 

w * 

** Three indicators, RQx, State Capacity Building, and State Plan, all 
O-l or 0-2 status variables, have essentially zero loadings on both 
Factor I and Factor IV. 



• Number of local educational agencies fLEAsl in 1079/1*,. mi f „ 

• * ESSE (^htf th enro,,ment 3oo is*i, , / ,0 

• Number of Intermediate Service Agencies (ISAO in 1077 n' , ri v* r •? 

• ES enrollment divided by number of ISaHiIa tti?n ?in (1 ?^ 10)f • ' 

MoffJoTl^ " mber ° f T6aCher Ceit6 ti 

• • Number of Institutions of Higher -Education (iHEs) in .974 (log 10) 

Demographic and Fin ancial i + . 

c%U«.^^ W P6r >*" »™ Perl 

• Ratio of staff salary to' per capita income (Staff Sal. /PC Income) 
Enrolment and Staff Sire . Total elementary and secondary school enroll- 
ment and total I HE enrollment were selected as general measures of the student ' 
population in each state. Among the several statistics on school staff, we 
selected the total number of elementary and secondary school (a) instructional 
staff, (b) consultants and supervisors, and (c) librarians. The last two were 
selected because of small, but possibly interesting variations from state to 
state in the proportion of these 'positions to instructional staff. ;? 

School Organizational Struct,,^. The states vary immensely in the number 
of school districtsf(from 1 in Hawaii and DC to over 1,200 in Nebraska). Since . 
most external dissemination efforts must work through LEA sactions, the number 
of LEAs was selected as a contextual indicator. Two other derivative indi- 
cators are the proportion of large urban LEAs and the proportion of very 



small LEAs. Large urban LEA, with enrollment over 25,000, constitute special 
dissemination and school improvement challenges. The proportion of large_ 
urban LEAs range from less than one percent to one* hundred percent. Very 
smaVI LEAs with enrollment -under 300 tend to be isolated rural schools. < The 
/proportions range from none to 85 percent of the'LEAs in each state. 

The Intermediate Service Agencies (ISAs), constitute a potentially 
c imj^rxant* dissemination and school improvement link between- the state and 
local education agencies. In 1977, twenty-nine states had a recognized ISA 
system, with one to 77 ISAs, In addition to the ISA count, we computed the 
ratio of school enrollment to ISAs in order to adjust the LEA count for dif- 
ferences in state school enrollments.* Teachers Centers represent another 
"grass roots" linkage for local instruction staff. As in the case of ISAs, 
both the number of teachers centers and ratio of .'instructional staff to num- 
ber of teachers centers were employed.* Finally, the number of institutions 
of higher education (IHEs) was noted, v 

.Demographic and Financial Indicators . Since we knew- that state school 
enrollment was almost perfectly correlated with state pppulation, the latter 
statistic was eliminated. However, two oth^r population related indicators 
were employed*. Population density, which varied from less than three to r 
over 12,000 persons per square mile, was considered as a potential ^useful in- 
dicator of ease of interpersonal communication and ease of physical access to 
knowledge resources. 

Seven financial indicators were employed. School expenditure per pupil 
and the two per capita school expenditure indicators all relate to general 

* Because ISAs and TCs do not serve all schools in some states, these ratios 
do not accurately reflect the average number of pupils' served per ISA or 
the average number of instructional staff served per TC 



r 
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-level of elementary and secondary_publicL.s^ 



pupil or per capita basis. Because state^school expenditure could be related 



to per capita income, we added per capita income and the rat^o of school expend 
iture per pupil to per capita income. This ratio indicator can be considered 
a crude measure of educational expenditure adjusted for per capita income dif- 
ferences. The last two indicators look more directly- at instructional staff 

salaries in terms of average instructional staff salary and in terms of the 

* ■ '*'-.'.-.■-*'■..' * 

ratio of staff salary to per capita income.* 

Factor Analysis of 20 Contextual Indicators .- A principal components 
factor analysis of 'twenty of these indicators, with Varimax rotation, produc- 
ed seven factors with Eigenvalues greater or equal OJB, accounting for 92 per-, 
cent of the trace. The results are displayed in Table 4.** 

Factor I, accounting for 31 percent of the common variance, is readily 
interpretable as a size factpr with very high loadings 'on all school enroll- 
ment and staff size indicators, and moderately high loadings on all counts 
of numbers of* educational agencies (LEAs, ISAs, TCs, and iHEs). ^ The some- 
what lower loadings for counts of types of institutions reflect the fact 
that the numbers of these institutions are not distributed- in as direct pro- 
portion to school enrollments as are school personnel. 



* Because per capita income is based on the entire population- in the state 
rather than wage earners, st;aff salary ratios are greater than one, and 
range from 1.56 to 2.75. 

** Since ES enrollment and ES staff correlated .99, the- ES Enrollment. l . 
Indicator was dropped frowr the factor analysis. Large Urban. LEA %, 
" which correlated .77 with number of LEAs, was also dropped. Using^ ? 

the standard Egenvalue cutoff af 1.0 produced, five factors . accounting 
* for 84 percent of the. trace. Inspection of five-j six-, and seven-f 0 actor 
* solutions led to the choice of the seven-factor solution in order to a 
produce factor scores that were most directly interpretable. ^ 

, 5 V 
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FACTOR ANALYSIS OF 20 CONTEXTUAL INDICATORS 
(N=51 States and DC) '•* ' 



CONTEXTUAL INDICATORS 


FACT) 


3RS (Decimals Gmmitted) 




II II 


III 


IV 


V 


VI 


VI I 


ES Staff ) 


98 


-02 


07 


11 


02 


-07 


:-03 


98 


ES Sups. 


91 


15 


06 


01 


-02 


-11 


01 


87 


LiJ^carians . * . 


92 


-05 


15 


22 


02 


-07 


-03^ 


93 


I HE Enroll. 


97_ 


05 


11 


02 


03 


-07 


-04 


97 


LEAs 


59 


-19 


-69 


13 


-17 


08 


-12 


92 


Small Lea % 


-29 


05 


-84 


^24 


-05 


16 


-14 


89 


ISAs 


65 


06 


-11 


-05 


-01 


01 


-75 


100 


ISA Ratio 


01 


-T4 


20 


17. 


07 


-09 


94 


99 


TCs 


68 


10 


" 02 


-67 


08 \ 


06 


-16 


*97 


TC Ratio 


30 


-13 


07 


91 


-08 


Vis 


14 


98 


IHEs 


93 


-15 


02 


-04 


-12 


-03 


-06 


90 


Density 


51 


13 


65 


-27 




04 


20 


87 


Pop. Change 


-02 


27 


-01 


-08 


87 


-09 


04 


84 


PP$ (expenditures) 


08 


97 


09 


-11 


-11 


-01 


00 


97 


PC $75 


-06 


96 


-11 


04 


06 


-06 


-07- 


95 


PC $76 


-18 


' 88 


-10; 


04 


15 


-04 


-12 


86 


PC Income 


04 


85 


11 


-17 


20 


39 


-04 


96 


PP $/PC Income 


05 


61 


-02 


02 


-43 


-52 


03 


83 


Staff Sal. 


20 


83 


19 


-08 


27 


-18 


00 


88 


Staff Sal. /PC Income 


21 


03 


14 


13 ' 


14 


-89 


08 I 


90 


Percent of CommorKVariance 


31 


23 


09 


08 


06 1 


07 


08 J 


92 
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Factor II, whi ^accounts for 23 percent of thereof variance, i< 
easily interpretable as an expenditure variable that displays high loadings 
on all measures of school expehdiSre and per capit^income^as well as the 
I staff salary measure. . M ' 

These first. two factors, size ^d expenditure, account Vor 54 percent 
of the common variance, and^re thusjby far £he strongest* two factors. None 
of the remaining five factor^accour#for more than nine percent of the com- 
mon variance in these 20 contextual indicators. 

Factor III displays a hif W^e loading on population density and 
high negative loadings on n^f| s Snd; , percent of small LEAs. Since the 
pure effect of size was removed in |Mv I (note that the density indicator 
also displays a high loading ^thi^acjor), Factor III may be. interpreted as 
assure of high relative density that.fe associated wig few LEAs and absence 
of very small LEAs. ■ ' % • >>/ ' 

Factor IV is almost purely a tejjp? center factor, however, the signs of 
the loadings indicate £hat ^houldfe^ interpreted as low teacher Center di^ 
tribution since the load in|'\s.^ati ve on number of teacher centers and highly 
positive of the ratio of intru^nal staff to number of teacher centers. 

Factor V is associated primarily with, positive population rh.nnp. n.ho. 
smaller loadings suggest' that positive percent of population change may be more 
in less dense states, and that positive population change may be associated 
with higher. per capital income and higher school staff salaries, but with 
lowerper pupil expenditure in relation to per capita income, 
y Factor VI is* Perhaps bes^jnterpreted as a low educational expenditure 
effort factor that is marked by a very high Negative. loading on the ratio of 
instructional staff salary to per capita income and also by a moderately high ■ 
negative loading for the ratio of per pupil expenditures (which include staff 
.' •' ' r. •'■ ' . 3> . . 



salaries) to per capita income. . The difference between these two negative 



loadings suggest that it is low salaries of teachers relative to per capita 
income that is the more prominent element. Please recall that factor II 
already accounts for most of the direct expenditure effect. Factor VI is a 
relative effort measure of schQol expenditure adjusted for P.C. income. Low 
effort states may tend to pay lower instructional salaries (this loading is 
very small, -.18), but they may not be low per capita income states (this 
loading is +.39). 

Factor VII is the ISA service factor . Like Factor IV, which is inter- ' 
preted as-low TC service, Factor VII is interpreted as 'low ISA service with a 
high negative loading on number. of ISAs and a very high positive loading on 
the ratio of ES Enrollment to number of ISAs (i.e.,Tiigh factor scores are 
associated with high ratios'—larger numbers of pupils per ISA). 

Summary. Factor analysis of 20 context measures produced seven factors: 



Size 




m 



Expenditure 



III 



High Density (Urbanization) 



Low Teacher Center Service 




Positive Population Change 



Low Relative Educational Effort 



VII 



Low ISA Service 



The first two factors are the most prominent. Ten context indicators 
are strongly associated with Factor I, and six are strongly associated with 
Factor II." The remaining factors are'each defined in terms of only two or 



t\\ree context indicators. 
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Relationships Between Context Indicators and Knowledge Reduction and Dis- 
— semtnat i on~Indi ca \tofs — ~ ~ ./, :r '" — ~ 

Multiple Correlation Analysis. Table 5 displays the correlations 
. between the seven context indicator, factor scores and the 13 indicators of 
*f knowledge production and dissemination. Due to the zero correlation among the 
orthoganal factor scores, the correlations in. Table 5 are also interpretable 
as regression beta weights, indicating the relative 'predictive power of each 
■ . context indicator factdr score to contribute to the multiple correlation with 
each of the 13 production and#dissemination indicators.* 

Inspection of the SIZE factor score correlations.; in. Table r 5%ipkly leads 
to a possible explanation for the high correlations among the first eigttt 
production and dissemination indicators. All eight of, these indicators are 
based on counts or estimates of counts (i.e, RIE documents, journal arjhcles, 
ERIC standing orders, computer search services, clearinghouses, val idated 
projects). With the exception of ERIC Clearinghouses, where"the correlation 
with the SIZE factor is only .39, the remaining correlation with SIZE range 
from .63 to .87. The size of the state (in terms of numbers of educational 
staff and numbers of educational agencies**) is thus a powerful predictor of 
the quantities of educational knowledge production outputs and dissemination 
services. For ERIC standing orders, where the .correlation is highest, the 
SIZE factor alone ts capable of accounting for three-fourths of all the^tate- 
to-state 'variation in number of standing orders. 1 The SIZE factor also 



The reader should note that orthoganal factor analysis also implies that 
the effects of) each factor are removed from the other factors, e.g., con- 

fvnfnH?? the J eac - er Cente . r (TC) faqtor « tW effects, size, educational 
expenditure, density, etc. a^g removed (controlled). 

** VIa fl5 e i fapt0 r !f also a1most P erf ectly correlated with school enrollment 
and total population. ( 
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TABLE 5 



CORRELATIONS BETWEEN CONTEXT INDICATOR FACTOR SCORES AND 

DISSEMINATION INDICATOR VARIABLES * 
(N = 51 States and DC) 



PRODUCTION ANO'blSSEMINATION 
INDICATOR VARIABLES 


• 

vS 

I 

z 

E 
I 


E 
X 
P 
E 
N 
D. 

II 


D 
E 
N 
S 
I 
T 
Y 

III 


• - 

T 
C 

IV 


. P 
0 
P. 

I 
N 
C 
R. 

V 


E 
F 
F 
0 
R 
T 

VI 


I 
S 
A 

VII 


R* 


1. State RIE documents 


.81' 


.30 


.19 










.88 


2. SEA-produced RIE documents 


.76 




.16 




-.15 


-.13 


-.14 


.81 


3. SCDE-produced document^ 


.73 


.25 










-.15 


.79 


4. ERIC Standing Orders 


.87 




.18 










.89 


5. ERIC Computer Search Services 


.74 


.26 




-.13 




-.12 


-.10 


;81 


6. ERIC Clearinghouses 


.39 


.34 


.14 




-.11 






.55 


7. . JDRP/DD Projects 


.72 


.18 


-.10 




.11 




-.19 


.78 


8. IVD Projects 


.63 




-.29 


-.14 






-.18 


.73 


9. SCB Grant Status 


.17 


.33 


-.12 








-.29 


.49 


.10. State Dissemination Plan Status 




.14 


-.18 


-.11 




-.10 


-.29 


.40 


11. RDx Serving State 


.23 


-.14 




-.38 






-.21 


.51 


12. RDU Linkages 


.40 


.15 






.12 




-.36 


.57 


13# NDN SF Ratings 


.37 




> 

-.19 


-.19 


-.18 






« .49 



* Multiple correlations are computed on the basis of all predictors with beta 
weights of .10 or larger. . 



Key to abbreviations: 



ERLC 



SEA^ 
SCDE - 
ERIC 
SCB 
JDRP 
IVD 
RDx 
RDU 
NDN 

TC f 
ISA 




Resources In Education 
St<&& Education Agencies 

Is, Colleges and Departments of Education 
Etional Resources Information Center 
Jh Capacity Building \ 
T _ rnt Insemination Review. Panel , 
State HNFntlflcatlon, Validation, Dissemination Project 
Research and Development Exchange 
Research and Development Utilization Project ' 
National Diffusion Network 
State Facilitator 

Teacher Center % 
Intermediate Service Agencies 
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contributes modest predictive weights for all remaining indicators except 
State. Dissemination Plan Status. 

The educational EXPENDITURE factor is the second most powerful predic- 
tor, contributing modest beta weights to (correlations with) nine of the' 13 
indicators.? States with higher educational expenditures tend to: produce 
.more RIE documents and more SCDE documents (RIE and journal), have^more com- 
puter search services, may have one (or- two) ERIC clearinghouses, slightly 
more. JDRP/DD projects (but not necessarily more IVD projects), have a SCB 
irant and perhaps a state dissemination plan or RDU linkages. Therfr is a 
very small tendency for states that expend more on education to not be part 
of the ROx Regional Service territory.* Note that the highest correlation, 
^^33-, . with . SCB Grant Status, only accounts for 11 percent of the covariance, - 
hence none of these relationships with the EXPENDITURE factor are very large. 
/' In terms of predictive contribution, Factor. VII / low ISA service is "the. 
- next most -powerful predictor. Low service is negatively correlated with nine 
. ■.• of the 13 indicators, implying that s^tes where ISAs operate and where the 
^ total number of ES enrollment divided by number of ISAs is relatively low 

will be states that are favored positively on many of the indicators. These 
i include: SEA productivity, SDCE productivity, computer search services, 
both JDRP/DD and IVD-val idated projects, SCB grant status* state dissemina- 
tion plan status, RDx service, and RDU linkages. Again, none of these cor- 
relations with TC service are very high;, the largest, -.36 with RDU linkages, 
accounts for 13 percent of the covariance. 



» - -i 



* Since the Appalachia Educational Laboratory's Regional Service area 
encompasseJFmost of the South-eastern states, this very small negative 
correlation? (-.14) is easily explained 
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. Fourth in predictive power. is the DENSITY factor. Although again the cor 

relations are quite modest, there is an interest ing pattern for thl g^Factor. 

DENSITY is positively associated with four of the ERIC-related measures' (State- 
RIE, SEA/RIE-, ERIC standing orders, and ERIC Clearinghouses); however, it is 
is negative for five other indicators (JDR0/DP projects, IVD projects, SCB 
grant status, state dissemination plan status, |nd NDN SF ratings). Denser 
states (typically with fewer LEAs and low percentages of very small LEAs) 
tend, slightly, to f*re better with respect to established document-based '• 
resources and not as well with the newer, validated practices and capacity 
building* activities. . '■ 

Fifth in predictive power is the Teacher Center (TC) Service Factor. 
Low TC service, is negatively associated RDx service (-.38), with NDN SF Ratings 
(-.19), IVD Projects (-.14) and ERIC computer searches (-.13);' however there 
is a small positive correlation with state dissemination planning (.11).* 

The POPULATION INCREASE factor score contributes in a very minor way (1% 
to 2%) to the prediction of five indicators. States with increasing population 
tend to have slightly more JDRP/DD projects (.11) and more RDU_linkages (.12) 
and slight,ly lower SEA productivity (-.15). There is also slightly less chance 
that;.they will have an ERIC Clearinghouse (-.11) or higher SF rating (-.18).** 



* Again we note that these are orthoganal factorj scores where the effects 1 
of other factors are removed. For instance^the zero-order correlation ' 
between Staff /Teacher Center and RDx is +.36jrwith NDN SF it is -.11, for 
ERIC computer searches it is +.09 and with state dissemination planning 
it is +.02. X 

** Zero order correlations 'between /the population increase context indicator 
. (not the factor score) and these same production and dissemination indica- 
tors are:. JDRP/DD (.11)„RDU (.10), SEA-RIE (-.05), ERIC Clearinghouse 
(-.04) and SF rating (-.15). 
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The relative EFFORT factor 'score (a measure of greater educational ex- 
penditure relative to per capita Income) is not related appreciably to any of 
the Indicators. There are three very small negative correlations that con- 
tribute only one to two percent to the prediction of three Indicators. Since 
this is a measure of Jow EFFORT, high EFFORT Is very slightly associated with 
higher SEA productlvlty^jnoj^ERIC computer services, and greater probability 
of having .developed a *state dissemination plan. 

In the last column of Table 5 are displayed the multiple correlations (R) 
computed on the basis of the displayed correlations. Themultiple Rs for all 
ERIC related indicators except the Clearinghouses are substantial', ranging 
fro* .79 to .89. The Rs for the two validated projects coi/nts are also 
quite high (.73 and .78). 

State Dissemination Plan Status is least well predicted (.40)*. The 
remaining multiple correlations range from .49 to .57. 

• The reader may want to note which predictor 'factor scores contribute what 
portion of the cova'riance. For this purpose the values displayed In Table 5 
must be squared. For example, total number of documents In RIE is predicted 
by three factor scores: SIZE (.81) contributes 65.6%, educational EXPENDITURE 
(.30) contributes 9.0%, and DENSITY <{ .19) contributes 3.6%, for a total 78.2% . 
of covariance; the square root of .782 is .88, which is the computed multiple, 
correlation. ' 

A Note on Significance and Reliability of These Results. Since all 50, ' 
of the United States and the District of Columbia constitute the defined popu- 
lation, this is a 100 percent sample and hence there is no sampling error. 



* Recall that this 1s a three point (0-2) measure, with the status" of 17 
states (including DC) unknown and assigned an iaUraedlate value of 1. 
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Consequently, all of the results, may be considered statistically ^significant. 
Of course there can be measurement error and there certainly may be changes 
in the indicator values over time. Hence significance in terms of reliability 
of measurement and generalization over time mst be considered. Most of the 
document-based knowledge production indicators involve large data bases, 
ence, the relative rankings among states can be expected to remain highly 
stablp^over Several years. The numbers of ERIC standing orders ancf computer 
senox^s are not as large as the document counts, but are still sufficiently ' 
large that relative positions of states should be reasonably stable over 
several years. The remaining validated practices and other dissemination in- 
dicators are expected to have less stability. For example, some^states could 
easily double or triple a very small number of validated practices. Additional 
states have already been included in the RDx Regional Service territory. / 
Several states* will prepare state dissemination plans in the next year or two. 
A new cohort of NDN State Facilitators (SFs) will eventually acquire skills' 
and expertise that may change the Ratings... and so on. For these reasons there 

/ a 

may not be very high stability for the newer, more "down-stream" 'and typically 
"human- 1 inkage" types of dissemination indicators. 

Expected stability among the context indicators is generally higher but 
yet variable. The relative positions among the states for most of the popula- 
<t<?pn and economic indicators should remain fairly stable over periods of several 
years. Because school enrollments are highly correlated with population, and 
educational staffing numbers are, in turn, highly correlated with school enrol 1- 
ment, these types of context indicators should be markedly stable. By qontrast, 
our data on Teacher Centers and ISAs are probably liss accurate; moreover, the 
numbers of TCs and ISAs can be expected to change sufficiently over several 
years to have some effect on the relative values among the states. 



4? 
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We can also note that, while the SIZE and educational EXPENDITURE factor 
scores are based on several measures and can thus average out measurement 
. errors, the, remaining factor scores are based on one or only a few measures 
and are thus more vulnerable to measurement errors.* 

these considerations of expected stability in indicators over time lead 
to two different types of conclusions. First, we can expect that the general- 
ly strongjrelationships between 'the SIZE factor score and counts of most 
document-based sources will be stable. Second, we are much less sure of 
the predictive' stability for the other indicators. The prediction equations 
for JDRP/DD projects may change slowly, however the prediction equations for 
ind1cators v such as RDx Service, State Dissemination Plan Status, or SF Ratings 
are probably far more subject to change over time. 

Canonical Correlation Analysis . " In the. above section we examined the use 
of seven orthoganal factor scores, based on contextual indicators, to compute 
multiple correlations with each of. 13 educational knowledge production and 
dissemination indicators. As we know the 13 indicators are interjcorrelated. 
We performed a second analysis in which the canonical Correlations between 
20 of the' original context indicators and the 13 production and dissemination 
indicators were computed. The goal of canonical analysis is tg define the 
primary independent dimensions which relate one'set of variables to another, 
in this case the context (predictor) indicators and the production and i 
dissemination (criterion) indicators. This technique, like factor-analysis, 
is primarily descriptive. - 



The two ratio indicators (TC Service and ISA. Service) are especially 
vulnerable to unreliability due to measurement errors in the counts of 
TCs and ISAs that are the denominators 'it) these raUps. The numerators 
1n these ratios are far more accurate. A 
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The analysis offers answers to three questions conterning: 

(1) The number of ways the two sets of indicators are related. 

(2) -The strength of each relationship. 

(3) The nature of the relationship. 

Although the maximum number of independent multivariate relationships 
will be equal to the smaller of the two sets' of indicators, 13 in this 
instance, we shall- summarize the results for only the first four most signif- 
icant canonical correlations. 

»• 

The first canonical correlation is .96+. jit involves all of the "size" 

\ « . 

indicators on the predictor side and all of -ther "counted" indicators on the 
criterion side. Large states tend to produce <more documents and validated 
practices and to have more of all of the countable dissemination facilities. 

The second canonical correlation is .89. ' It involves a combination 
of all of the educational expenditure measures plus higher number of LEAs, 
ISAs, TCs and (high) percent of small LEAs in the predictor side, with SCB 
Grant Status, validated projects; NDN State Facilitator Ratings, anoVRDU 
Linkages prominent" on the criterion side together with more modest associa- 
Hons with ERIC computer searches and all three (state-wide, SEA, SCDE) of 
tfrfe document- production indicators. 

We note that the criterioji sides of these first two canonicals are quite 
similar to the two factors plotted in Figure I, page 22; i.e., they seem to 
involve the prediction of c printerily document-based indicators in the first 
canonical and primarily, but not exclusively, the more human-linkage 
indications in the second canonical. 

The third canonical correlation is .91. It involves the majority of the 
context indicators, but it best interpreted in terms of high ISA numbers, high 
TC -numbers, high staff salaries, together with somewhat higher size measures 
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and educational expenditure on the predictor side, that are associated with 
higher numbers of validated projects and ERIC search services .-and, to a lesser 
extent, greater productivity on all three document measures, more RDU linkages 
and greater probability of being a SCB Grant recipient. This third canonical ' 
suggests a^pattern in which the existence of intermediary structures, e.g., 
ISAs and TCs, accompanied by above average size and expenditure, are associated 
with a wide range of production and dissemination advantages, including espe- 
cially more* validated projects and' information search services. 
_s • The fourth canonical correlation is .84. This canonical is interpretable 
in terms of high per pupil and per capita educational expenditures, high per 
capita income, and high instructional staff salaries, with low density, a 
larger percentage of v&ry small LEAs, and perhaps fewer pupils per ISA. .These 
predictors are associated with a combination of criteria that are marked espe- 
cially by higher probability of RDx services and the existence of a state plan, 
together with the presence of RDU linkages, and higher SCDE document produc- 
tivity, but with lower SEA-RIE counts and fewer ERIC computer search services. 
This canonical pattern m^ typify some of the more affluent, but less dense 
states where document productivity is associated primarily with the SCDEs, 
and some ISA services are available. Although these states may or may not 
be part of the State Capacity Building (SCB) Program, they*tend to have pro- 
duced a state dissemination plan, have RDU linkages, and are probably in the 
RDx Regional Service territory. Or the contrast for the opposite side of 
this canonical pattern may be less affluent \ Tbut denser states with lower 
SCDE productivity, but higher SEA-RIE productivity, with little or no ISA 
service, that tend not to have state plans or RDU linkages or be in the RDx 
service area. 

s 
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Discussion of Relationships of Predictors to Production and Dissemination 

Iiidicators. In the above sections we have presented the. results of multiple 

correlation ana canonical correlation analysis of the relationships between 

contextual measures and 13 indicators of educational knowledge production 

and dissemination. We have seen that measures of size (e.g. school enroll- 

* 

ment, staff size, number of LEAs) are highly intercorrelated with all pro- 
duction and dissemination measures that are counted (e.g., nwiber of docu- 
ments in RIE, number of computer search services, number of validated pro- 
jects), and that size' of the state accounts for much of the intercorrela-/ 
t ions among these ^^^P d indicators. States wittf large school populations 



simply tend to produce more educational documentation and more exemplary 

projects, and to v have more dissemination structures. In many cases Size 

.<* * 

alone account^ for as muoh as 50 to 66 percenffof the covariance. Ne(xt to 
Size, the level of Educational Expenditure also acts as a positive predirte&c^ 
for many indicators. Presence of intermediate struciScas^such as Intermediate 
Service Agencies (ISAs) and Teacher Centers (TCs) also adds small Increments 
to the multiple correlations for many indicators. Density (urbanization) is 
only weakly related to most of the production and dissemination indicators, 
, but with positive correlation with the ERK-related indicators and negative 
correlation with the non-ERIC indicators.* 

The Population Increase and Effort/income-predictive measures..contribute 
only one or two percent covariation to a few of the indicators. For many of 
the ERIC indicators, Size by itself is almost as good a predictor as the en- 
tire set of seven predictor factors; whereas, for the remaining indicators, 



* We note that this latter pattern is consistent with the conclusion 
of Emrick Peterson and Argawala-Rogers (1977) that NDN has an inten- 
sionally stroiig^cucal bias. 
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.^|e other six predictor factors add considerable predictive strength to Size 
alone. It seems, then, that although a state's document-based productivity, 
dissemination (and we also suspect its utilization) can be predicted effec- 
tively by some simple quantitative measures of size, it is necessary to know 
considerably more about a state "to do at all well in predicting less document 
oriented aspects of its dissemination capability. In the canonical correla-" 
tion analysis^ we found-even stronger correlations between the set of context 
measures and the set of production and dissemination indicators. 

Scatterplots. The first and largest canonical correlation was inter- 
preted as representing the joint relation between size pred|ctors and all- 
counted-. Indicators (i.e., the ERIC-related indicators and the validated pro-, 
jects). To- avoid dealing with canonical weights and scores, we went Jback to 
our factor analyses and selected the SIZE factor score /from the contextual 
indicator factor analysis (p. Z$ and the ERIC factor Jcore from the produc- 
tion and dissemination factor analysis (p. 20). The scatterplot of this rela- 
tionship is displayed in Figure 2. When the SIZE factor score fs used to pre- 
dict the EMC factor score, the correlation is .85, which means that SIZE 
accounts for nearly three-fourths of the variance among states on the ERIC 
factor score. . ♦ 
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FIGURE 2 



SCATTERPLOT OF SIZE FACTOR SCORE BY *ERIC FACTOR SCORE 
Ik ' J'OR 50 STATES AND WASHINGTON, DC 
W , (r = .85) 
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* In Figuj^e 3 we display the scatterplot of the educational EXPENDITURE 
factor score with ^he ERIC factor score. Although EXPENDITURE is the second 
most powerful predictor, the correlation is only .19. ^ 

FIGURE 3 I 

StATTERPLOT OF EXPENDITURE FACTOR SCORE BY ERIC FACTOR SCORE / 
FOR 50 STATES AND WASHINGTON, DC ' 
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Finally, in Figure 4, the scatterplot of a weighted combination of the 
SIZE and EXPENDITURE factor scoreswlth the ERIC factor score Is displayed. 
It may.be of Interest to note that the it*tes that are somewhat off the re- 
gression line in Figure 4, I.e., DC, Virginia. Ohio, Illinois, and New York, 
are all somewhat higher on ERIC product iv1& and dissemination than would^e 
predicted by their SIZE and EXPENDITURE combined. 



FIGURE 4 
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DEVELOPMENT OF A TYPOLOGY OF STATES 



was 



The: Initial ^stimulus for examination of quantitative indicators. 
Interest in. developing an objective basis for classifying or typing states in 
terms of <the1r knowledge production, dissemination, or utilization character- 
istics. The analyses reported above are prel Imlnary steps designed to gain 
better understanding of the exploratory set of indicators that had been se- 
lected. The predictive power of the contextual indicators was anticlpaftfe 
yet the very strong relationships, especially with SIZE, were a b1t$|p$8| 
prise. In the following sections, we report results of two types of hier^rchlaT 
grouping analyses..* The first 1s based on the educational knowledge production 
and dlssemlnatlo^ Jndlcj^rsjr the second on context indicators. 

V Oeveft)pment of a Typology of States Based on Educational Knowledge Production 
and Dissemination Indicators . 

A hierarchlal grouping analysis of states was run based on all 13 of the 
production and dissemination variables. The results of the last six stages 
of grouping are displayed 1n Figure 5. At the six-group level, a discriminant 
analysis showed that at least two groups differed significantly on all of the 
13 indicators. The states comprising the^x groups and .the descriptions of 
the distinguishing characteristics of the.se groups are presented on the left 
side of the table. The way the groups combine is depicted on the right side. 
The groups are 1n sequence from highest production/dissemination capability on 
the top of the page to lowest capability on the bottdm. Because of their' 



Iff rd /™I. T .2 63 ^ a 9glomerat1ve hierarchical grouping method was employed through 
the HGROUP program (Veldman, 1967). All measures were standarized prior to 
grouping. r 



grouping 
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FIQURE 5 

HIERARCHIAL GROUPING OF STATES BY PJ®D#£faON 
< .AND DISSEMINATION INDICATORS^} 




f in Group 



■ V 

7 • : 



(6) (5) (4) (3) (2) (1) 



(2) 



1. CA, NY 



(12) 



(7/ 



(14) 



(9) 



(7) 



• Highest on all ERIC indicators,' 

• Highest on JDRP projects 



2. CO, FL, GA, IL, MA, Ml, MN, OR, 
PA, TX, WA, WI ' . 

• High on all ERIC indicators— ^ V 

• High on JDRp-'p ^^ ^^ 

3. .AZ, CT, IA, KS, NE, NJ, UT 

• Moderate on ERIC indicators 

• High on SCBt, state plans, 
a JDRP projects, ,NDN State . 

Facilitator ratings 



°4. AR, DC, IN, LA, MD, MS, MO, NM, 
NC, OH, OK, TN, VA, WV 

• Moderate on ERIC indicators 
. • Low on SCB, state plans, JDRP 
projects, NDN State Facilitator 
ratings 



5. AL, AK, DE, HI, ID, KY, MT, NV, » 

- SC 



Low on all ERIC indicato 



rs 



6. ME, NH, ND, RI, SD, VT, WY . » 

1 • Lowest on all ERIC indicators 




9 
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massive size, California (CA) and New York (NY) tend to remain "as a* sepa- 
rate pair until, only four groups remain. Although groups 2 and 3 differ 
somewhat on relative level of the ERIC-related indicators, their similari- 
ties on other non-ERIC indicators (generally hi^fh on SCB, state"^arrs7^JDRP^ — : 
validated projects, and NDN State Facilitator ratings) cause them to merge 
first, and then to join CA anti NY to compose a group of 21 states con- 
sisting of the top 3 groups. The major difference between groups 3 and 4 
is th^t group 4, while moderate on the ERIC indicatory, is lower than group 
3 on the riorr-ERIC indicators. Group 4,^ however, is sufficiently higher 
.than groups 5 and 6, that group/4 maintains its oWn grouping until only 3 
groups remain. Groups 5 and. 6 combine at the four-group stage to create a 
group of 16 states that tend to be low on nearly all the ERIC indicators. * 

Development of a Typology v of States Based on Contextual Indicators 

In order to see what groupings of states would emerge on the basis of 
the contextual variables, three analyses were run. Figure 6 displays results 
at the six-group level for the first two analyses. On the -left are the results 
obtained by using nine context variables loading primarily on the yiE and 
EXPENDITURE factors. A discriminant analysis indicated that there were sign if- 
icant differences on all nine size and expenditure variables. The states 
comprising the six groups and the descriptions of the distinguishing character- 
istics of the groups are presented, with the groups in sequence from highest 
size and expenditure on the top to lowest size and expenditure on the bottom. 

Despite the fact that size and expenditure variables were shown to be 
powerful predictors of production and dissemination capacity' (especially for 
the ERIC-related indicators), the other five factors (DENSITY, POP. INCREASE, 
TC SERVICE', ISA SERVICE, and EFFORT) do contribute something to prediction, 
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FIGURE 6 - / 

HIERARCHICAL GROUPING OF STATES BY PREDICTOR VARIABLES AND 

BY PREDICTOR FACTORS 



BY PREDICTOR VARIABLES ...... BY SEVEN PREDICTOR FACTORS 

(Size anoExpendTtcre^orrly)- — ^ ■ : — — ■ 



1-5 CA, FL°. JL, OH, JX 1-8 CA, CT, Jt, KS, IMA, HO, NJ, TX 

• Highest on school staff size ■'•«'.' 

• Highest on number of IS As 

• Highest on number of teacher centers 

• Highest on number of LEAs -M 

6-15 CT, IA, M>, HA, M, MN, NJ, NY, PA, W \ ^,W6 AZ.'ttE, Mlv MN, NM, NY, PA, HI 

t High on sqhool^taff size V 

t High populatlon-denslty 

• Highest on per pupil expenditure/ 
0 .* „ per capjta .income * 

t High on number of ISAs 
t High on number of teachers centers 
t High onr number of LEAs 

16 " 34 S- & 2h" "S- -IS- -J& Mi 17.-36 AL, CO, FL, 6A, 10, IA, Mff NE, 

NM, TO, W. OR, SO, UT, VT, I, W NH, TIC, NO, OH, W 9 OR 3ff TJT 

^ * , ■„ «A, W, WY ~ 

, t Moderate on nearly all size and — — 

wealth variables 

• Highest on percentage of LEAs y 

which xro email » 



which are .small 

35 " 45 & M ' E» ^' NC - SC « IS* 37 "«« «. 1", KY, LA, MS, SD, TN 

t High on school staff size 

• Lowest on population Increase 

t Lowest on per pupil expenditure 
t Low on percentage of LEAs which 
are small 

46-49 DE,DC.W,R! - 45-49 OE, OcJ III . HO. RI 

■ t Lpw school staff size 

t Highest per pupil expenditure 
ft High per pupil expenditure/per 
capita Income 
t Low on number of ISAs 

• Low on number of LEAs 

t Lowest on percentage of LEAs \. . . 
J which are small .f 

50-51 K 9 W , 50-51 • AK, NV 

t Lowest school staff size ^ 

t Lowest population density * 

t High per pupil expenditure 

" • Lowest on number of ISAs 0 

t Low on number of teacher centers 

t Low on number of LEAS % 

t High on^ercentage of LEAs which 



S-i 



VA 
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— - ewtf^MForthe non-ERIC indicators. Results of groupie on the basis of 
^ the seven contextual measure factor scores are displayed on the right hand ' . 
sidyf Figure 6. The results are similar as can be seen by comparing the 
two groupings. Most of the states (33 of 51 5 underlined) occur in the same 
- group in the two analyses; only five states; occur in groups that are more 
than pne rank apart. (FlorTSa, Maryland, apd Ohio occur in. a lower-ranked 
group when all seven factors instead of just size and expenditure variables 
are used} Kansas and Missouri occur in higher-ranked groups when all seven 
factors are used.) 

Figure 7 presents a comparison of the six group analyses for the nine 
s1ze and e3 <penditure predictor variables and the 13 indicators. In this case 
there are only 19 states that are in the same group levels in these two anal- 
yses.* One explanation for the poor matching is the fact that the numbers of 
states in comparable levels of groupings are quite different, e.g., there are 
'five s'tatesMri the tqp group on the left'hand side in Figure 7, but only two 
states on the right hayjd side. ^ 

However, there: is another possible problem. In terms of predicting the ■ 
full set of 13 production arid dissemination ihd^ators, . both of these groupings 
have faults. The grouping by size and expenditure measures alone omits the 
minor contributions made by the other five factors^' However, the grouping by 
seven predictor factors gives all seven factors equal weight, which is far 
fro^ the results obtained in the multiple correlation analysis (see Table 5) ' 



Comparison of &> grouping by 13 indicators with the grouping by seven 
factor- scores, mws^hat there are 16 states i n the laSf level? of 
groups. 



ERJC - 



HIERARCHIAL GROUPING OF .STATES BY NINE SIZE AND EXPE#TURE 
PREDICTORS AND By THIRTEEN INDICATORS 



G ROUPING^ ~9 PRFniCTQR VARIABLES 
(9 size ana txpenditure only) . 

1-5 CA, Ft, IL, OH, TX • "' 

• Highest on school staff size 

• Highest on number of I SAs 

«• Highest on number of teacher centers 

• Highest on number of LEAs 



GROUPING BY 13 INDICATORS 

(13 ERIC and non-tRIC variables) 



1-2 CA, NY 



6-15 



CT, IA, MD, m, NJ, NY, 

rA » HI 



0 



High on school staff size 

High population density 

Highest on per pupil expenditure/ 

per capita income 

HigbaJn number of ISAs 

High on number of teacher centers 

High on number of LEAs 



16-34 AZ, CO, ID, KS, LA, HE, MO, MT, 

W;Ja;K' no - 0K - or ' so -^v 

•Moderate on nearly all size and 
wealth variables 

• Highest on percentage of'LEAs 
v which are small 

• High on school staff size 
>■> '• Lowest on population increase I 

• Lowest on per pupil expenditure 

• Low on percentage of LEAs which 
are small 

46-49 OE, DC, HI, RI 



Low school staff size 
Highest per pupil expenditure 
Hfgh per pupil expenditure/per 
capita income 

Low on number of ISAs " ' 
Low on number of LEAs 
Lowest on percentage of LEAs 
which are small 



0-51 AK, NV 



Lowest school staff size 
Lowest population density 
High per pupil expenditure 

Lowest on n umber IfTTSAr- — 

Low on number of teacher centers^ 
Low on number of LEAs 1 
High on percentage of LEAs which 
are small 



3-14 



• Highest on all ERJC indicators 

• Highest on IMP projects 



S; 5: ft s- 

o 

• High on all ERIC indicators 

• High on JDffp projects 



22-35 



15-21 AZ, CT, IA, KS, NE, KJ f UT ' 

• Moderate on all ERIC indicators 

• High on State Capacity Building grants 

• High on state dissemination 'plans 

• High on JDRP projects -tit 

• ;High on NDQf State Facilitator ratTrtgs 

AR, DC, IN, LA,«», MS, M0,.NM, 
K> OH, W, .TN, VA, W 

• Moderate on all ERIC indicators 

• Low on State Capacity Building grants 

• Low on state dissemination plans 
o Low on JDRP projects 

• Low on NDN State Facilitator ratings 

AL, AK, DE, HI, ID, KY, MT, NV, 

SC " 

• Low on aT[ ERIC indicators 



36-44 



45-5L HE.^NItf NO, RI, SO, VT, HY 
_y • Lowest on an ERIC indicators 



- To ^PP™*imat^ 

ten context measures: '~ 

1. 'Instructional staff size - 
. ^ 2. Number of consultants and supervisors 

' 3. Hunker of IHEs " 



4. n^mbep of"LTAs ■ ' \ 

* ' I 

' ■ 5. Number of very small- LEAs 

6. Population change * 

7* Per capita ed. expenditure, 1975 , - ,- \ 

8. Per pupil expenditure/PC Income 

9. Intermediate Service "Agency (ISA) Ratio 
10. sjeacher Center (TC) Ratio 

The results of this analysis in terms of ten predictors (chosen to roughly • 
approximate the multiple correlation analysis weights) are displayed on the 
T-eft hand side of Figure 8. Comparison to the right hand size shows that 
there are now 26 states in the same groups on each side (double underlined). 

Again there is the problem that the two sets of groupings result in 
groups that are not the same size, on the left and right. If we combine adja- 
cent pairs of groups on each side as suggested by the horiz^wta+^rTneTTwe 
arrive at three groups of states on each side. Although a coarser level of 
discrimination is required in this instancje- r we ? find that 38 states are matched 
at the same level of^grou^jjig'on'^ath sides (double underlined states that are 
matcji^a±-fehe^sTx-group level plus single underlined states that are matched at 
the three-group level). In terms <3f this three-level grouping, only one state, 
Oregon * is located more'/than one group away. Oregon, which is in the bottom^ 
gr^eup on the predictor side, is in the top group on^the indicators side. (It 
ioves from fifth to second in terms of the sii-level analysis.) St|tes that. 

er|c§ . > 5 ? 
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F4GURE-8 



HIERARCHIAL GROUPING BY TEN PREDICTORS AND 



BY THIRTEEN INDICATORS 



GROUPING BY 10 PREDICTORS 

1-6 IA, MJ_, MN, NY, PA, WI_ 

7-15 CA, CO, CT, FL, IL, MA, . 
OH, TX, WA 

aszssBcsasszasBBgssaasssascssjsssss 

16-19 AZ, AR, KS, MD 



GROUPING BY 13 IND I CATORS 



1-2 CA, NY 



3-14 



CO, FL, GA, IL, HA, MI, 
MN, OR, PA, TX, WA, WI 



15-21 • AZ, CT, IA.'KS, NE, NJ, UT 



20-32 AL, IN, GA, KY, LA, MS, 
MO, NJ, NM, NC, SC, TN, 

»= ~" XX XX 9 XX * 

/ VA 

xxsxaxxxxai 



IB8S39«iSBSaa8S88SSSSB: 



33-41 DC, DE; HI, MT, NE, OK, 

I s " == "" 

or; ri, ut 



42-51 /aK, ID, ME, NH, ND; NV, 
SD, VT, WV, MY 



22-35 AR, DC, IN, LA/MD, MS, 
.* ~T " 

MO, NM, NC, OH, OK, TN, - 

JA, WV 

ca==rs==ss»s^:=== =========3= - ======== 

36-44 AL, AK, DE, HI, _ID, KY, 

-••Hi M. sc 

1 

45-51 ME, NH, ND, RJ_, SD, VT, WY 



0 

ERIC 
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iook petter in terms of their indicator level that .their predictor level/ in- 
clude: .Georgia, Oregon, District of Columbia, Nebraska, Oklahoma, and ikah. 
Those states that are located in a Jower group dn the indicator side than '.' 
t would be expected given their location on the predictor side include: I<bwa, 
Connecticut, Ohio, Alabama, Kentucky, and South Carolina.* /' 

Given the. fact that the ten predictor meferes are completely independent 
of the 13 indicators, the. results displayed in Figure 8 provide some assurance 
that states can be typed at least roughly, and that comparable groupings cari^e 
^obtained from completely different sets of data. Twelve of the 14 states (86% 
accuracy) that are placed in the highest of three groups in terms of their pro- 
duction and dissemination indicators are also in the highest of three groups 
based on their contextual indicators (size, expenditure, etc.). At the other' 
extreme, 13 of the 16 states (81% accuracy)' that are placed in the lowest of 
three groups in terms of their production and dissemination indicators are 
also in the lowest of three groups based on their contextual indicators. The 
accuracy of placement is least for the middle group.** Of the 17 states in 
the middle group on the predictor side, 13 are also found i^the/middle group 
on the production and dissemination indicator side (76% accuracy). 



Because of the differences in numbers of states at comparable levels, one 
of three states (IA,«tT,. or OH) would have to be located in the second 
level on the indicator side, because there are 15 states in the top group 
on the predictor side, but only 14 states in the top group on the indicator 
side. Similarly, three of^the 19 states in the bottom group must be placed 
in the middle group on the indicator side since there are only 16 states in 
the bottom group on the indicator side. Consequently, at least four states 
must be misclassified, simply due to unequal groups on the two sides. ( 

** Because there are 21 states in the middle gro.up on the indicator side but 
only 17 states in the middle group on the predictor side, this middle group 
on the indicator side must include four states that were classified in top 
or bottom groups oh the predictor side. 



COMPARISON OF USOE REGIONS 



Since the UyS. Office of Jducation has organized its services to sbtes 
by ten regions, it mig^Tbe interesting to see if there are differences among 
the, USOE Regions either in terms of educational knowledge production and dis- 
semination capability or inarms of the contextual factors that are predic- 
tive of this capability. We shall examine the contextual factors first. 

' • — ' 

Comparisons of Regions on Contextual Factors 

Sin^e tbe $even contextual factor score's contain most of the- information 
avai faBle in 20 contextual measures, we employed the.s,e factor scores to lo0^>>:; 
for regional differences. ' . ° • '* * "+J&'*'\.' 

. One-way Analysis of Variance. The one way. analysi^f variance .jshows • • . 
that the USOE Regions differ significantly on at*1east '-four, if the. W^n^ ^ 
facfor scores: SIZE, EXPENDITURE, DENSITY, AND '*?m0t$k. t^M^^ex^ns 
did notVdlffer.reyabl^pn the TEACHER CENTER SBRVI^*" ^St^^^'iJoSi; • 
factors.* The mean factor scores) (and rankings). for each^^h/lO ; US0E 



Regions are ■ shown in Table 6. ' ^ - '■ '•'.'•."i- • / 

Wfth^a little study of this, tabl e, the reader, can/cbm|^e pgiorjs on" \ j ..' ■ 
... ' one or more factors. For example: on the 'EXPEI^JTUR^'ifacXr^b^sed on' VaVi- * 'j': < 
1 ab1es such as school expe nditure per puoil! per capita schbtt^DendUur e r ■' 4 ■" 
and instructional staff average sal aryl. ^egionll (New York and few Je*s«y) ' 7 
and Region X (Alaska, Idaho, Oregon', and Was'tfingS) arevhvghest; while' *. ' *? 

Region IV (Alabama, Florida, Georgia, Kent uc.kyV Misses ippi, North 'caco^na, \ V 



As noted previously there is no sampl i ng error*- but there m^-be measure- 
ment error, especially in the last three factor^seores (TC/ ISA, EFFORT) • 



in Table 6. » . .- ? 

•V* / 




MEAN FACTOR SCORES (AND RANKINGS) OF THE 10 USOE REGIONS ON 
•• DISSEMINATION' CONTEXT FACTORS 
(M = 50;' S.D. = 10) 



J 




South Caroli ha, and Tennessee), and Region VI (Arkansas, Louisiana, New Mexico, 
Oklahoma, and Texas) are lowest. Similarly, one can compare the scores of 
factors for regions of interest. For example: Region II (New York and New 
Jersey) is higher than any other region on SIZE and EXPENDITURE, moderate on 
DENSITY*, and lower than any other region in POPULATION INCREASE. 

Compariso n of Regions on Production and Dissemination Indicators 

One-way Analysis of Variance . Analysis of the 13 production and dis- 
semination indicators suggest that the USOE Regions may differ significantly 
on as many as eight indicators. The greatest differences in order of the 
size are: ' RDX Service, number of ERIC Standing Orders, number of SEA-produced 
documents in RIE, number of ERIC Clearinghouses /number of RIE documents, NDN 
State Facilitator Ratings, number of JDRP/DD projects and number of ERIC Com- 
puter Search Services. Two other indicators, SCDE Productivity and State Plan 
Status, display substantially less reliable differences. Differences on the 
remaining three indicators, SCB Status, RDU Linkages and IVD Projects, are 
so small, relative to within region variation^ that they may be considered un- 
reliable.** The values in Table 7 are directly interpretable. In each case 
the sum of the indfcators for states is divided by the number of states 



Please recall that the DENSITY (Urbanization) factor is measured not 
only in terms of population density, but also in terms of low numbers 
of LEAs and low percentages of small LEAs. 

** It has been noted that statistical tests based on random sampling assump- 
tion^ are not appropriate for 100 percent samples. However measurement 
errors and? changes in indicators over time make it less likely that small 
differences among regions, relatives within-region differences among 
states, will persist reliably. Data in Table 7 are ordered by size of 
the one-way analysis of variance- F-ratio. If this ratio is small, the 
difference may be unreliable. 



— •- TABLE 7 — — . ,• ■; ■ 

MEAN SCORES (AND RANKINGS) OF THE 10 USOE' REGIONS I 
ON KNOWLEDGE PRODUCTION AND DISSEMINATION INDICATORS^ 



PRODUCTION 
DISSEMINATION 
INDICATORS 



USOE' 



REGIONS 



I 



II 



III 



IV 



VI I VII I VNll IX 



F-RATIO 
i(SIGNIF. 
LEVEL) 



RDx Service I (9) 
(0-1) I .00 



(9) 
.00 



(6) 
.83 



(15) 
.88 



(2.5) 
1.00 



(2.5) (2.5) 
LOO 1.00 



(7) 
.33 



(9) (2.51 
.00| 1.00 



12.89 
»(.Q000) 



ERIC Standing I (9) 
Orders flog) 1 0. 56 



"(1) 
1.47 



(5) (3.5) 
1.021 1.06 



(2) 
1.15 



(3.5) 
1.06 



(6) 
0.86 



j (10) 
0.47 



(7) 
0.73J 



(8) 
0.6J 



3.06 

_U007) 



SEA-RIE 

Hog) 



(9) 
1.81 



(1) 

2.81 



(3)1 (5) 
2.201 2.10 



(2)1 (6)1 
2.42 ^2.071 



(7) 
2.06 



(8) 
1.82 



(4) 
2.18 



(10) 
1.58 



2.57 



ERIC Clearing-! (9) 
houses (#) I 0.0 



(1) 
1.5 



(3) (19) 
0.7| 0.0 



0.8 



(6.5) I (9)1(6.5)1 
0.21 0.01 0.2 



(4.5) (4.5) 
0.3| 0.3 



2.37 
(.029) 



State RIE 

dog) 



(9) 
2.57 



(1) 
3.38 



(3)1 (6) 
3.23| 2.89 



(2) 
3.34 



(7) (5)1 (10)1 
2.851 2.941 2.54 



(4) (18) 
3.00 2.72 
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~~in tne region. ThTWC - Standing Orders, SEA-RIE, State RIE, andrSCDE Pro^ 
ductivity^measures are mean logs (base 10) for each region. The values of 
ERIC Clearinghouses, JDRP/DD Projects, and ERIC Computer Search Services are 
means of the actual number of ERIC Clearinghouses, JDRP/DD Projects, and ERIC 
Computer Search Services. For RDx Service, since a state either receives a 
score of "0" (absent) or "1" (present), the table value can be intrepreted 
as the percent of states in the USOE Region that had RDx Services (in 1977). 
The NDN SF Rating and State Plan Status are means based on 0-4 and 0-2 scales, 
respectively. 

For example, Region II (NJ, NY) is the highest ranking region on six indi- 
cators: RIE Standing Orders, SEA-RIE, ERIC Clearinghouses, State RIE, JDRP/DD 
Projects, and ERIC Computer Searches. (All six of these indicators are based 
on counts. As we have noted in Table 6, Region-II is also by far the highest 
ranking region on both SIZE and EXPENDITURE, the two most powerful predictors 
of count data.) In Region II, the average, per state, is 35 ERIC Standing Or-" 
ders j^l-pg = 1.47), several hundred SEA documents, several thousand state-wide : 
RIE documents, 1.5 clearinghouses, ten JDRP/DD -P/J'ects, and 13.5 ERIE Computer 
Search Services. The average SF RatifcgVs 2.0 and State Plan Status is 1.0 
(unknown for NJ and NY). -Neither state was served by a RDx Regional Exchange / 

(.oo). . ' ; 

: 6 : 

Region I (CT, MA, ME, NH, RI, VT) presents a stark contrast, ranking 
seventh to ninth on all indicators except the NDN SF Rating, wTiich is 
second highest among the regions. 

Region VII (IA/ KS, MO, NE) displays a broad range of rankings. It is . ^ 
first in the NDN SF Ratings, second in average SCDE productivity, th^Vd in 
State Plan Status, fourth in average number of JDRP/DD Projects, fifth in""-"? 
r 4/ average number of RIE documents, it is tied with Region VIII for eighth/ninth 



place in average number of computer search services and is tied with Regions 
I and IV in last place for complete absence of ERIC Clearinghouses. 

> Discriminant Analysis .* In an initial analysis all 13. indicators were 
employed. The results indicated that the RDx%tatus indicator might be 
masking interpretation of the effects of the other indicators so RDx was 
omitted and a second analysis was run.** 

The cehtroids for the first three discriminant dimensions in this second 
analysis are displayed in Table 8. In this analysis the first discriminant 
root accounts for 37, percent of the variance, the second for'24 percent and 
the third for 14 percent. Hence, these first three roots account for three- 
fourths of the total variance. Unfortunately the .three dimensions are com- 
plex, therefore, ijt may be helpful to look at some figures that plot the 
relationships graphically. In Figure g are plotted the USOE Region centroids 
for the second and third discriminant 'dimensions. : 

Both the second and the third discriminant dimensions are identified 
by positive correlations (.3 to .7) on all six of the ERIC-related. indica- 
tors. The major differences between the two dimensions aie that the second 
^dimension places greater emphasis on<ERIC Standing Orders arkl Computer 
Searches, i.e., on document-based dissemination systems , while the. third 

* Discriminant analysis may be considered as an extension of single clas- 
sification analysis of variance that included simultaneously a group of 
dependent variables. A discriminant analysis of the contextual factors 
was not run since these factor* scores are statistically independent. , i 

** Tab>e 7 shows that*there are rnass^e differences among the USOE Regions 
in RDx service proportions with ari^F-ratio much larger than the other in- 
dicators. The RDx indicator is the major element in the first discrimi- 
nant root which extracted 54 percent of the variance. Correlations of 
other indicators with the first discriminant dimension were not large, 
but^were in the .2„to .3 range for four indicators. By omitting the RDx 
variable, the effects of the remaining 12 indicators are easier to inter- 
pret. See page 21 where RDx, was dropped in our interpretation of factor 
analysis results. 
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USOE REGION CENTROIDS 
ON KNOWLEDGE PRODUCTION AND DISSEMINATION INDICATORS 
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dimension is marked by greater emphasis on NDN State Facilitator Ratings,, 
JDRP/DD Projects, and I VD Project, i.e., by exemplary practices dissemina- 
tion systems '. The dotted diagonal lines in Figure 9 roughly define the major 
conceptual axes. Region, II (NJ, NY) ranks first on every ERIC-related indica< 
tor, while Regions I, VIII, and X are among the lowest ranking on these indi- 
cators. Generally, the higher a region is along this diagonal axis, the 
higher will be the means for all ERIC production and access indicators. The 
second dotted line defines an axis that most markedly separates the regions 
'in ternjs of their.mean SF Ratings. The-^ive USOE Regions to the right of the 
dotted line are the five highest ranking, and^those td-the left are the -five 
lowest ranking on the SF Ratings. Although much 16ss consistent across 
regions, there is also a small difference irv relative numbers on Standing 



USOE REGION CENTROIDS FOR SECOND AND THIRD DISCRIMINANT DIMENSIONS 
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THIRD DISCRIMINANT DIMENSION ' 



the regions in terms of the Size factor.* 

Figure 10 displays the centroids- for the first and second discriminant 
dimensions. The first discriminant dimension is a fairly well defined bipolar 
dimension with State Plan Status, RDU Linkages, and SCDE Productivity defining 
the positive side and ERIC Computer Search Services, ERIC Clearinghouses, 
JDRP/DD Projects, and SCB Grant Status" defining the negative side. The high 
side of the first 'dimension seems to characterize regions^ that contain states 
that'have developed' dissemination plans, have productive SCDE faculties, and 
have above average RDU Linkages, but that terid to have few ERIC Clearinghouses, 
ERIC Computer Search Services, and JDRP/DD Projects, and that may not have SCB 
• Grants. As we have previously noted in examining Figure 9, the second discrim- 
inant dimension is identified on its htah side with higher counts on all ERIC- 
related indicators and especially by Jpfah ERIC Standing Order and ERIC Com- 
puter Search Services counts. 

Thus one sees in Figure 10 a horizontal separation of regions in terms 
of SIZE and concomitant productivity, with a vertical separation of regions 
that, contrasts relative lack of capacity building, computer searches, clearing- 
houses, and JDRP/DD projects, all perhaps more organized and centralized forms 
of dissemination, with presence of state plans,- productive colleges of educa- 
tion, and more "RDU linkages on the high positive side, As we move vertically 
down Figure 10, the pattern tends to shift. RDU linkages disappear. SCDE 
productivity is less, at least when relative SIZE is considered, and State , 



I ,nI^L ls especially pronounced for Region VII which ranks fourth 
for JDRP//DD Projects and is tied for eigth/ninth ranks on ERIC Computer 
Search Services, and for. Reg iori III which ranks last in JDRP/DD Projects' 
but is fourth for ERIC Computer Search Services. •' rujKL "v 
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USOE REGION CENTR0I#FOR FIRST AND SECOND DISCRIMINANT DIMENSIONS 



FIGURE 10 
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Man status is mixed or unknown, As; : we cross into the negative side, we 
find only Regions IX (AZ, CA, HI, Nvj and H (NJ, NY). Here large SIZE is 
confounded with presence of Computer Search Services, Clearinghouses, large 
numbers of JORP/DD Projects, etc. But SCDE Productivity is only average and 
. RDU LinkagesVe average (in IXkor non-existent (in ,11). 

In Figure 11, the USOE RegZs are plotted against the fi&£|d third- 
discriminant dimensions. Both of these dimensions have been described. The 
abbreviations for the key indicators defining the ends of the dimensions have 
been added. . ^ 

Region VIPs high positive position on both dimensions is explained i> 
terms ofits first ranking on NDN SF ratings, second ranking on SCDE produc- 
tivity, third rankings on State Plan Status and IV0 Projects, ahd fourth ' 
ranking on JDRP/DD Projects. Region V is also high positive on both dimen- 
sions. Region V ranks second on" eight indicators, first in SCDE Productivity, 
third in SF Ratings, fourth in State Plan States, and fifth in SCB Status. 

Region Il's extreme positions on bo^the first and the third discrimi- 
nant dimensions have been noted. It is highest on all counts including ERIC 
indicators and bpOTfcidated projects indicators, but it is low on RDU 
Linkages and State % status, and only average in SCDE Productivity. 
Regions I, VIII, (and IX, which form a cluster near the center, sharJft low 
IVD Project countS^nd low ERIC Standing Order counts.' Regions I anWlI are 
also among the lowest in State-RIE and SEA-RIE counts-and in ERIC 'Computer 
Search Services. Region IX is separated vertically in the negative direction 
from Regions I and VIII by virtue of having substantially more ERIC Computer 
Search Services, JDRP/DD Projects, and a slightly higher percentage of ERIC 
Clearinghouses. 
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. FIGURE 11 

USOE REGION CENTROIDS FOB FIRST AND THIRD DISCRIMINANT' 'DIMENSIONS 
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MapRjng of State^ . Figure 12 maps the states in terms of their ERIC 
factor score/ (a cW>?nation of all ERIC-related indicators of production and 
dissemination). This mapping indicates graphically that there are both 
' between-region and within-region differences in ERIC facilities and produc- 
tivity levels. f 

it 

Figure 13 is 



a mapping of the states on publi^school staff size. This 
is one of several highly intercorrelated measures of size that have been 
shown to be strongly predictive of all the ERIC-related measures. The gen- 
eral correpondence between Figures 12 and 1^ is visually obvious. 

Relationships Between Contextual* Predictors and ProductiorWDissemination 
Indicators Within USOE Regions s 0 

It has been shown that it is possible to classif^states into groups \ 
and to characterize tho^ groups on the basis of similarities and differences 
in contextual measures that predict production/dissemination capabilities and 
%lso on the basis of similarities and differences in direct measures of some 
aspects of production and dissemination capacity. It has also been shown 
that, when states are grouped by geographic regions (i.e., USOE Regions), 
the regions do differ 'on many of these dissentf nation predictors and indica- 
tors. This would seem to indicate that there are geographic effects oper- 
ating either directly on educational- knowledge production and dissemination 
or on contextual factors that are related to (and influence?) dissemination. 
It is interesting to discover that despite these differences between regions 
on such variables and factors as SIZE and ERIC production and dissemina- 
tion, the strong predictive relationship between SIZE ahd ERIC is main- 
tained within each region as well. It can be seen in Figures 12 and 13 that, 
for the states within 'each of the 10 USOE Regions, the correlation between 




I I States which are more than one standard deviation below the 
1 — 1 mean on the score. 

HH States which are between the mean and one standard deviation 
below the mean on the score. 

HI States which are between the mean and one standard deviation 
MH above the mean on the score. 

States which are more than one standard deviation above the 
mean on the score. 
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FIGURE 13 



D^RIBUTION OF STATES ON PUBLIC SCHOOL STAFF SIZE/ i\ ,., 
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STZE/arid ERICs : is approximately the same. (The previously identified outlier 
statesXof .New York, Ohio, Illinois, Vlrginia.^and District of Columbia lessen 
the' correlation in three of the regions.) 
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CONCLUSIONS 

Despite the simple_yariables chosen as indicators and potential pre- 
dictors of production and dissemination capacity in this. initial work, we 
have been able to make ^promising ^ginning in predicting state dissemi- 
nation capability and developing a typology of states based on dissemina- 
tion capability. Our major conclusions to-date are: 

• SIZE (e.g., school enrollment, instructional staff size, 
population, density, number of consultants and supervisors 
of instruction,' number' of school librarians) is the single' 
most powerful predictor of state educational knowledge pro- 
duction and dissemination, 'capability./ 

• SIZE is particularly goo^|at predicting ERIC productivity 
and dissemination .(correlations of SIZE with ERIC variables 
range from .73 to .87). 

• A weighted sum of SIZE and EXPENDITURE factor scores cor- 
relates,. .87 with ERIC factor scores (a composite of all the 

\ > , « 

ERIC variables). 

0 

• SIZE is less highly correlated with non-ERIC indicators of 
dissemina tion, but when combined with other predi.ctors 
(EXPENDITURE, DENSITY, TEACHER CENTERS, POPULATION INCREASE, 
ISA), the multiple correlations range from .40 to .78. 

• States can alsojbe grouped on the basis of their "scores" on 
production/ -dissemination capacity variables. ^Using a typol- 
ogy of six groups results in groups of states which can be 
clearly characterized, dfctinguished, and described according 
to their dissemination characteristics. 

■ i • • i - \ 
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t States can also be grouped on the basis of the, contextual 
.factors or measures that predict dissemination. , ^ 

t The typology based on dissemination predictors and the typol- 
ogy based on dissemination indicators are quite similar; many 
of the states cluster into 1^ same groups^in the two typol- 
ogies. 

t Though the typology of states based on geographic proximity - 
USOE Regions) is quite different from the typologies created 
to maximize dpff&qnces between groups on dissemination indica- 
tors,, or prfSjtfictors of dissemination, there are considerable and 

^ 1 • ■ ... 

consistent differences between i he USOE Regions on many of the 
dissemination predictors and on many of the dissemination indi- 
cators. 

t The relationship between SIZE and ERIC productivity and dissemi- 
nation remains strong evett for states within each of the 10 
USOE Regions* . 



it 
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FUTURE DIRECTIONS 

We are continuing to expand and refine our attempts to develop predic- 
tors of dissemination and typologies of states based on dissemination indi 
cators. Some of the directions we are now taking are: 

• Further study of geographic distribution and relationships 

. * ^ ■ ■ ■■£"* 

among indicators afft three levels of aggregation--regional , 
state, and Stfl£As. ^ 

t Further examination of data on the distribution of and ' f , 

services provided to special populations (e.g., minorities, * 
handicapped, geographically isolated). 

t Development of indicators of* utilization and examination of 
their use as "dependent 11 variables in time series analyses of 
state-by-state trends and their causal determinants. 

• Development, analysis of the reliability of, and use of 
subjective indicators (e*g. , judgmental ratings of relatively " 

0 

intangible qualities such as "dissemination leadership" or 
■•technical effectiveness"). . „ 

• \ Development of more detailed predictive or ^causal models 

designed to account for regional of state* variance in dissemi- 
nation or utilization indicators. * 



• Sensitivity analysis of t/e stability of model parameter 

v 

estimates. 

t Examination of residual or^bu^lier cases to attempt to account 
for the reasons for poor fit between data and the predictive 
models. 
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